Jul 09 15:26:17.168851 ip-10-0-130-22 systemd[1]: Starting Kubernetes Kubelet... Jul 09 15:26:17.578211 ip-10-0-130-22 kubenswrapper[2581]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:17.578211 ip-10-0-130-22 kubenswrapper[2581]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 15:26:17.578211 ip-10-0-130-22 kubenswrapper[2581]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:17.578211 ip-10-0-130-22 kubenswrapper[2581]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 15:26:17.578211 ip-10-0-130-22 kubenswrapper[2581]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 15:26:17.579672 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.579577 2581 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 15:26:17.584086 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584071 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584087 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584092 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584095 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584106 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584110 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584112 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584115 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584118 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584121 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584124 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584127 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584130 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584132 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.584132 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584135 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584151 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584155 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584158 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584161 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584164 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584166 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584169 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584172 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584175 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584178 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584180 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584183 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584186 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584188 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584190 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584193 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584196 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584199 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584202 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.584478 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584204 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584206 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584210 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584213 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584215 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584218 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584220 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584223 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584225 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584227 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584230 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584232 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584235 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584237 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584242 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584246 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584249 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584252 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584255 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584258 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.585009 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584261 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584264 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584267 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584269 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584272 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584274 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584277 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584279 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584282 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584285 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584288 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584290 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584292 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584295 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584297 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584300 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584302 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584305 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584307 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584312 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.585512 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584315 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584318 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584320 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584322 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584325 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584327 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584331 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584334 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584336 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584339 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584341 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584344 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584346 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584349 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584351 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584354 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584357 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584359 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584361 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.585995 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584364 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584366 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584369 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584371 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584374 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.584376 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586354 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586362 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586365 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586368 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586371 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586373 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586376 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586379 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586382 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586384 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586387 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586389 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586392 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586395 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.586451 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586398 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586400 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586402 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586405 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586407 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586410 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586412 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586414 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586417 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586419 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586422 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586424 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586426 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586429 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586432 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586435 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586437 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586440 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586442 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586445 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.586952 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586457 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586461 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586464 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586467 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586470 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586473 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586476 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586479 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586483 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586486 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586489 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586507 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586511 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586513 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586516 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586519 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586522 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586525 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586528 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586530 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.587474 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586533 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586536 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586538 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586541 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586543 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586546 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586549 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586552 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586555 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586557 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586560 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586562 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586564 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586567 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586569 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586572 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586574 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586577 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586581 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.588028 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586584 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586587 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586590 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586593 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586596 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586599 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586601 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586604 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586607 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586609 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586612 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586615 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586617 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586620 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586624 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586629 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586631 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586634 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586636 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586640 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.588563 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586642 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586645 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586647 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586650 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586653 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.586655 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587024 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587028 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587031 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587035 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587040 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587043 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587046 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587049 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587052 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587054 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587057 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587059 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587062 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.589055 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587065 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587067 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587070 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587072 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587075 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587077 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587080 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587083 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587085 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587088 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587090 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587093 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587095 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587118 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587123 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587126 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587129 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587132 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587134 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.589527 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587138 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587142 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587144 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587147 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587149 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587152 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587154 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587157 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587160 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587162 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587165 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587167 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587169 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587172 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587174 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587176 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587179 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587181 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587183 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587186 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.589987 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587189 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587192 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587195 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587197 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587200 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587203 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587205 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587208 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587212 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587214 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587216 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587219 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587221 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587224 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587226 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587228 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587231 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587234 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587236 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.590469 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587238 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587242 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587244 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587247 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587249 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587252 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587254 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587256 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587259 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587261 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587264 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587266 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587268 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587271 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587273 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587276 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587279 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587281 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587283 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587286 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587288 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.590939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587290 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587293 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587295 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587297 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587300 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587302 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.587305 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587372 2581 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587380 2581 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587386 2581 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587390 2581 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587394 2581 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587397 2581 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587404 2581 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587411 2581 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587417 2581 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587421 2581 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587426 2581 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587431 2581 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587436 2581 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587439 2581 flags.go:64] FLAG: --cgroup-root="" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587442 2581 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587445 2581 flags.go:64] FLAG: --client-ca-file="" Jul 09 15:26:17.591471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587447 2581 flags.go:64] FLAG: --cloud-provider="external" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587451 2581 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587459 2581 flags.go:64] FLAG: --cluster-domain="" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587462 2581 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587465 2581 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587468 2581 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587471 2581 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587481 2581 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587484 2581 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587488 2581 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587505 2581 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587508 2581 flags.go:64] FLAG: --contention-profiling="false" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587511 2581 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587515 2581 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587518 2581 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587522 2581 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587526 2581 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587529 2581 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587531 2581 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587534 2581 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587537 2581 flags.go:64] FLAG: --enable-server="true" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587540 2581 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587544 2581 flags.go:64] FLAG: --event-burst="100" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587548 2581 flags.go:64] FLAG: --event-qps="50" Jul 09 15:26:17.592040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587551 2581 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587554 2581 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587557 2581 flags.go:64] FLAG: --eviction-hard="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587561 2581 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587563 2581 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587566 2581 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587569 2581 flags.go:64] FLAG: --eviction-soft="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587572 2581 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587575 2581 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587579 2581 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587584 2581 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587587 2581 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587590 2581 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587593 2581 flags.go:64] FLAG: --feature-gates="" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587597 2581 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587600 2581 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587603 2581 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587606 2581 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587610 2581 flags.go:64] FLAG: --healthz-port="10248" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587612 2581 flags.go:64] FLAG: --help="false" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587615 2581 flags.go:64] FLAG: --hostname-override="ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587619 2581 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587622 2581 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 15:26:17.592640 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587625 2581 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587628 2581 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587631 2581 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587634 2581 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587637 2581 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587640 2581 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587642 2581 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587645 2581 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587648 2581 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587652 2581 flags.go:64] FLAG: --kube-reserved="" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587655 2581 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587657 2581 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587660 2581 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587663 2581 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587666 2581 flags.go:64] FLAG: --lock-file="" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587669 2581 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587672 2581 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587675 2581 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587682 2581 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587687 2581 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587689 2581 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587692 2581 flags.go:64] FLAG: --logging-format="text" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587695 2581 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587699 2581 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 15:26:17.593241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587702 2581 flags.go:64] FLAG: --manifest-url="" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587705 2581 flags.go:64] FLAG: --manifest-url-header="" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587709 2581 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587712 2581 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587716 2581 flags.go:64] FLAG: --max-pods="110" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587719 2581 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587722 2581 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587725 2581 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587728 2581 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587731 2581 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587734 2581 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587737 2581 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587744 2581 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587747 2581 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587750 2581 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587753 2581 flags.go:64] FLAG: --pod-cidr="" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587756 2581 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587762 2581 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587765 2581 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587768 2581 flags.go:64] FLAG: --pods-per-core="0" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587771 2581 flags.go:64] FLAG: --port="10250" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587774 2581 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587777 2581 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-041570ebb4b983cfc" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587780 2581 flags.go:64] FLAG: --qos-reserved="" Jul 09 15:26:17.593836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587783 2581 flags.go:64] FLAG: --read-only-port="10255" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587786 2581 flags.go:64] FLAG: --register-node="true" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587789 2581 flags.go:64] FLAG: --register-with-taints="" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587795 2581 flags.go:64] FLAG: --registry-burst="10" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587798 2581 flags.go:64] FLAG: --registry-qps="5" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587801 2581 flags.go:64] FLAG: --reserved-cpus="" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587803 2581 flags.go:64] FLAG: --reserved-memory="" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587807 2581 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587811 2581 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587814 2581 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587816 2581 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587820 2581 flags.go:64] FLAG: --runonce="false" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587823 2581 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587826 2581 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587829 2581 flags.go:64] FLAG: --seccomp-default="false" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587832 2581 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587834 2581 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587838 2581 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587840 2581 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587844 2581 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587847 2581 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587849 2581 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587852 2581 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587855 2581 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587858 2581 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 15:26:17.594420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587861 2581 flags.go:64] FLAG: --system-cgroups="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587864 2581 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587870 2581 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587873 2581 flags.go:64] FLAG: --tls-cert-file="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587876 2581 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587880 2581 flags.go:64] FLAG: --tls-min-version="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587883 2581 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587886 2581 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587889 2581 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587891 2581 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587897 2581 flags.go:64] FLAG: --v="2" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587901 2581 flags.go:64] FLAG: --version="false" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587905 2581 flags.go:64] FLAG: --vmodule="" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587908 2581 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.587911 2581 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588030 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588034 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588038 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588040 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588043 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588046 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588048 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588051 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.595059 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588054 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588057 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588059 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588062 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588064 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588066 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588069 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588071 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588074 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588076 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588079 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588083 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588090 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588093 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588096 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588107 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588110 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588112 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588115 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.595764 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588119 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588122 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588125 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588127 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588130 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588133 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588135 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588138 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588140 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588143 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588145 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588147 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588150 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588152 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588155 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588157 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588160 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588163 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588165 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.596247 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588167 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588170 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588172 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588174 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588177 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588179 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588182 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588186 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588189 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588192 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588195 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588197 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588199 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588204 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588206 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588209 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588211 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588214 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588216 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.596752 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588219 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588223 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588225 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588228 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588231 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588233 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588236 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588238 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588241 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588243 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588245 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588248 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588251 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588253 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588256 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588258 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588261 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588263 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588266 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588268 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.597244 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588270 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588274 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588276 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588279 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588281 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588283 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588287 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588289 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588292 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588294 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588297 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588299 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588302 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.588304 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.588871 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:17.597756 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597049 2581 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597065 2581 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597085 2581 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597094 2581 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597153 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597159 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597162 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597165 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597168 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597171 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597174 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597177 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597180 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597183 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597185 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597188 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597191 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597194 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597198 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.598135 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597201 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597203 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597206 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597209 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597211 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597214 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597217 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597219 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597221 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597224 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597227 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597229 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597232 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597236 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597241 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597243 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597246 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597249 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597252 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.598627 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597254 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597257 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597260 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597264 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597268 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597271 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597274 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597277 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597280 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597283 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597285 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597288 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597290 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597293 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597297 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597300 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597303 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597305 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597308 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.599107 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597310 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597313 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597315 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597318 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597320 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597322 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597325 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597328 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597331 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597334 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597336 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597339 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597341 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597343 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597346 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597348 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597350 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597353 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597355 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597357 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.599618 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597359 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597362 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597364 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597367 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597369 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597371 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597374 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597377 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597379 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597382 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597384 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597387 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597389 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597391 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597394 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597396 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597398 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597401 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597403 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597406 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.600131 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597408 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597411 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597413 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597415 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597418 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597420 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597425 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597560 2581 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597565 2581 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597568 2581 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597571 2581 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597574 2581 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597576 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597578 2581 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 15:26:17.600670 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597581 2581 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597583 2581 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597586 2581 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597588 2581 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597591 2581 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597593 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597596 2581 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597598 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597600 2581 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597603 2581 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597605 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597608 2581 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597610 2581 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597612 2581 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597615 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597617 2581 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597621 2581 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597625 2581 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597628 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 15:26:17.601039 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597631 2581 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597633 2581 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597636 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597638 2581 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597641 2581 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597643 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597645 2581 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597648 2581 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597650 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597654 2581 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597657 2581 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597660 2581 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597662 2581 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597665 2581 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597668 2581 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597670 2581 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597673 2581 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597675 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597678 2581 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597680 2581 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 15:26:17.601532 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597683 2581 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597685 2581 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597688 2581 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597691 2581 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597693 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597695 2581 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597698 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597701 2581 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597703 2581 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597706 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597709 2581 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597711 2581 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597714 2581 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597716 2581 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597719 2581 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597721 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597724 2581 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597726 2581 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597729 2581 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597731 2581 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597733 2581 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 15:26:17.602025 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597736 2581 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597738 2581 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597740 2581 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597743 2581 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597745 2581 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597748 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597750 2581 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597753 2581 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597755 2581 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597758 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597760 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597763 2581 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597766 2581 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597768 2581 feature_gate.go:328] unrecognized feature gate: Example Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597771 2581 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597773 2581 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597776 2581 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597778 2581 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597781 2581 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597783 2581 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 15:26:17.602557 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597786 2581 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597789 2581 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597791 2581 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597794 2581 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597796 2581 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597798 2581 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597801 2581 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597805 2581 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597807 2581 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597810 2581 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597813 2581 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:17.597815 2581 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597820 2581 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.597948 2581 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 15:26:17.603051 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.600050 2581 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 15:26:17.603392 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.601464 2581 server.go:1019] "Starting client certificate rotation" Jul 09 15:26:17.603392 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.601572 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:17.603392 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.601610 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 15:26:17.604249 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.604228 2581 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:17.607642 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.607622 2581 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 15:26:17.616545 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.616525 2581 log.go:25] "Validated CRI v1 runtime API" Jul 09 15:26:17.619149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.619131 2581 log.go:25] "Validated CRI v1 image API" Jul 09 15:26:17.619894 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.619878 2581 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 15:26:17.624615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.624594 2581 fs.go:135] Filesystem UUIDs: map[26d386e7-523d-4617-bc47-a112ddfe1caa:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 fea4a7c9-13ea-45d5-af2e-428463275524:/dev/nvme0n1p3] Jul 09 15:26:17.624693 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.624614 2581 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 15:26:17.631346 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.631220 2581 manager.go:216] Machine: {Timestamp:2026-07-09 15:26:17.629878909 +0000 UTC m=+0.345156420 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3101625 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec238639cade8ebcc15ebb9310c7e209 SystemUUID:ec238639-cade-8ebc-c15e-bb9310c7e209 BootID:a0025a45-1e19-4fe2-b281-71299c441ad7 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e8:5c:10:ff:8b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e8:5c:10:ff:8b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:3e:9b:13:bc:0b:8b Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 15:26:17.631346 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.631339 2581 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 15:26:17.631466 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.631434 2581 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 15:26:17.634742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.634712 2581 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 15:26:17.634905 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.634747 2581 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-130-22.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 15:26:17.636295 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.636277 2581 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 15:26:17.636330 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.636302 2581 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 15:26:17.636330 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.636318 2581 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:17.636995 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.636983 2581 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 15:26:17.638301 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.638290 2581 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 15:26:17.638864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.638849 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:17.641836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.641824 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:17.641959 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.641949 2581 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 15:26:17.641992 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.641982 2581 kubelet.go:486] "Attempting to sync node with API server" Jul 09 15:26:17.642019 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.641996 2581 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 15:26:17.642049 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.642020 2581 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 15:26:17.642049 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.642034 2581 kubelet.go:398] "Adding apiserver pod source" Jul 09 15:26:17.642049 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.642047 2581 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 15:26:17.642515 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.642487 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:17.642580 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.642526 2581 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 15:26:17.647812 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.647781 2581 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 15:26:17.650663 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650647 2581 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 15:26:17.650740 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650680 2581 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 15:26:17.650834 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650825 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 15:26:17.650869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650840 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 15:26:17.650869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650846 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 15:26:17.650869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650852 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 15:26:17.650869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650861 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 15:26:17.650869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.650867 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 15:26:17.651365 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651354 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 15:26:17.651365 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651367 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 15:26:17.651424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651375 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 15:26:17.651424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651381 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 15:26:17.651424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651389 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 15:26:17.651424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.651397 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 15:26:17.653074 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.653060 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 15:26:17.653112 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.653076 2581 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 15:26:17.654050 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.654019 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 15:26:17.654166 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.654049 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-130-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 15:26:17.656465 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.656448 2581 server.go:1268] "Started kubelet" Jul 09 15:26:17.656592 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.656540 2581 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 15:26:17.656646 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.656615 2581 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 15:26:17.657172 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.657140 2581 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 15:26:17.657526 ip-10-0-130-22 systemd[1]: Started Kubernetes Kubelet. Jul 09 15:26:17.657793 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.657767 2581 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 15:26:17.659038 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.659023 2581 server.go:310] "Adding debug handlers to kubelet server" Jul 09 15:26:17.662193 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.662143 2581 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 15:26:17.663716 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.663696 2581 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 15:26:17.663716 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.663708 2581 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:17.663889 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.663870 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:17.664313 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664291 2581 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 15:26:17.664424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664312 2581 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 15:26:17.664424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664331 2581 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 15:26:17.664577 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664535 2581 reconstruct.go:97] "Volume reconstruction finished" Jul 09 15:26:17.664577 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664544 2581 reconciler.go:29] "Reconciler: start to sync state" Jul 09 15:26:17.664833 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664813 2581 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-130-22.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 15:26:17.664968 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664939 2581 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 15:26:17.664968 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664968 2581 factory.go:55] Registering systemd factory Jul 09 15:26:17.665083 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.664982 2581 factory.go:223] Registration of the systemd container factory successfully Jul 09 15:26:17.665230 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.665215 2581 factory.go:153] Registering CRI-O factory Jul 09 15:26:17.665270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.665235 2581 factory.go:223] Registration of the crio container factory successfully Jul 09 15:26:17.665270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.665258 2581 factory.go:103] Registering Raw factory Jul 09 15:26:17.665337 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.665274 2581 manager.go:1196] Started watching for new ooms in manager Jul 09 15:26:17.665781 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.665759 2581 manager.go:349] Starting recovery of all containers Jul 09 15:26:17.665966 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.664858 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-22.ec2.internal.18c0a88d63c4dc6b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-22.ec2.internal,UID:ip-10-0-130-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-130-22.ec2.internal,},FirstTimestamp:2026-07-09 15:26:17.656417387 +0000 UTC m=+0.371694895,LastTimestamp:2026-07-09 15:26:17.656417387 +0000 UTC m=+0.371694895,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-22.ec2.internal,}" Jul 09 15:26:17.674894 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.674721 2581 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-130-22.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 15:26:17.675028 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.674996 2581 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 15:26:17.675943 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.675920 2581 manager.go:354] Recovery completed Jul 09 15:26:17.682055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.682041 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.684002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.683982 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.684097 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684020 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.684097 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684059 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.684712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684624 2581 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 15:26:17.684712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684631 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.684712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684638 2581 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 15:26:17.684712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.684657 2581 state_mem.go:36] "Initialized new in-memory state store" Jul 09 15:26:17.685319 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.685300 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.685399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.685333 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.685399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.685346 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.686052 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.686039 2581 policy_none.go:49] "None policy: Start" Jul 09 15:26:17.686095 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.686056 2581 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 15:26:17.686095 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.686066 2581 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 15:26:17.686583 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.686517 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-22.ec2.internal.18c0a88d6569c37d default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-22.ec2.internal,UID:ip-10-0-130-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-130-22.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-130-22.ec2.internal,},FirstTimestamp:2026-07-09 15:26:17.684001661 +0000 UTC m=+0.399279175,LastTimestamp:2026-07-09 15:26:17.684001661 +0000 UTC m=+0.399279175,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-22.ec2.internal,}" Jul 09 15:26:17.687213 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.687201 2581 policy_none.go:47] "Start" Jul 09 15:26:17.695641 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.695620 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-99wmt" Jul 09 15:26:17.696334 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.696269 2581 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-130-22.ec2.internal.18c0a88d656a2414 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-130-22.ec2.internal,UID:ip-10-0-130-22.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-130-22.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-130-22.ec2.internal,},FirstTimestamp:2026-07-09 15:26:17.684026388 +0000 UTC m=+0.399303897,LastTimestamp:2026-07-09 15:26:17.684026388 +0000 UTC m=+0.399303897,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-130-22.ec2.internal,}" Jul 09 15:26:17.701798 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.701778 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-99wmt" Jul 09 15:26:17.723111 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723091 2581 manager.go:337] "Starting Device Plugin manager" Jul 09 15:26:17.723232 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.723124 2581 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 15:26:17.723232 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723134 2581 server.go:87] "Starting device plugin registration server" Jul 09 15:26:17.723419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723407 2581 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 15:26:17.723454 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723424 2581 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 15:26:17.723544 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723525 2581 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 15:26:17.723630 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723608 2581 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 15:26:17.723630 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.723622 2581 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 15:26:17.724178 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.724156 2581 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 15:26:17.724254 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.724211 2581 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:17.805531 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.805469 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 15:26:17.806855 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.806829 2581 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 15:26:17.806950 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.806871 2581 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 15:26:17.806950 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.806897 2581 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 15:26:17.806950 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.806939 2581 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 15:26:17.809485 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.809461 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:17.824559 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.824535 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.825536 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.825517 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.825620 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.825555 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.825620 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.825570 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.825620 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.825598 2581 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.834825 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.834757 2581 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.834825 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.834787 2581 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-130-22.ec2.internal\": node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:17.887705 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.887673 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:17.907755 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.907704 2581 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal"] Jul 09 15:26:17.907832 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.907796 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.908796 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.908778 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.908867 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.908812 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.908867 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.908823 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.910304 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.910291 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.910419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.910403 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.910478 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.910435 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.911051 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911036 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.911127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911065 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.911127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911076 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.911127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911035 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.911217 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911139 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.911217 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.911148 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.912409 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.912394 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.912468 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.912422 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:17.913181 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.913169 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:17.913264 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.913192 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:17.913264 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.913202 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:17.929080 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.929056 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-22.ec2.internal\" not found" node="ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.933243 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.933226 2581 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-130-22.ec2.internal\" not found" node="ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.965744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.965714 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.965744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.965744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.965862 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:17.965764 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5194c3f0f86f0f687ce0565b6dadc74e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-22.ec2.internal\" (UID: \"5194c3f0f86f0f687ce0565b6dadc74e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:17.988210 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:17.988185 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.066550 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.066627 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066571 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.066627 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066589 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5194c3f0f86f0f687ce0565b6dadc74e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-22.ec2.internal\" (UID: \"5194c3f0f86f0f687ce0565b6dadc74e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.066627 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066527 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.066717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066629 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/50435ba66f3042ab3dfd2a2a1f355d26-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal\" (UID: \"50435ba66f3042ab3dfd2a2a1f355d26\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.066717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.066616 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5194c3f0f86f0f687ce0565b6dadc74e-config\") pod \"kube-apiserver-proxy-ip-10-0-130-22.ec2.internal\" (UID: \"5194c3f0f86f0f687ce0565b6dadc74e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.088688 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.088620 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.189538 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.189484 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.231726 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.231680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.237051 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.237033 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:18.289750 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.289718 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.390918 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.390853 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.491761 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.491728 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.593513 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.593459 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.600823 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.600789 2581 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 15:26:18.601027 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.601005 2581 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 15:26:18.632681 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.632651 2581 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:18.655635 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.655548 2581 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:18.694032 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.693983 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.704971 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.704926 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 15:21:18 +0000 UTC" deadline="2027-12-04 12:58:16.605912527 +0000 UTC" Jul 09 15:26:18.704971 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.704968 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12309h31m57.90094976s" Jul 09 15:26:18.794113 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.794062 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.802481 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.802440 2581 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 15:26:18.804102 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.804078 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientMemory" Jul 09 15:26:18.804255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.804113 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 15:26:18.804255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.804123 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeHasSufficientPID" Jul 09 15:26:18.859963 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:18.859917 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5194c3f0f86f0f687ce0565b6dadc74e.slice/crio-0f8fb9c45316a96369fec6217520cb34b06697b1f1d75cdeda510bb0d5507bd6 WatchSource:0}: Error finding container 0f8fb9c45316a96369fec6217520cb34b06697b1f1d75cdeda510bb0d5507bd6: Status 404 returned error can't find the container with id 0f8fb9c45316a96369fec6217520cb34b06697b1f1d75cdeda510bb0d5507bd6 Jul 09 15:26:18.864691 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:18.864674 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:26:18.894338 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.894302 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:18.995815 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:18.995733 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:19.096872 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.096835 2581 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-130-22.ec2.internal\" not found" Jul 09 15:26:19.194914 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.194887 2581 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:19.264645 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.264551 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" Jul 09 15:26:19.277243 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.277211 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:19.278489 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.278469 2581 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" Jul 09 15:26:19.294514 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.294480 2581 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 15:26:19.462764 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.462722 2581 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 15:26:19.643638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.643526 2581 apiserver.go:52] "Watching apiserver" Jul 09 15:26:19.651867 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.651838 2581 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 15:26:19.652273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.652249 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-mwhms","openshift-network-operator/iptables-alerter-xn4q5","openshift-ovn-kubernetes/ovnkube-node-rffnq","kube-system/global-pull-secret-syncer-fxxwc","kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj","openshift-cluster-node-tuning-operator/tuned-vz5jv","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal","openshift-multus/multus-6jmlt","openshift-multus/multus-additional-cni-plugins-5jkkd","openshift-multus/network-metrics-daemon-985tq","kube-system/konnectivity-agent-hzct9","openshift-dns/node-resolver-9h98t","openshift-image-registry/node-ca-pzrzd"] Jul 09 15:26:19.653966 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.653937 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.655245 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.655226 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.656566 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.656542 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.657531 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.656884 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.657531 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.656912 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.657531 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.656925 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-f9nfq\"" Jul 09 15:26:19.658167 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.658145 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.658338 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.658179 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.658338 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.658216 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 15:26:19.658338 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.658311 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-7zgjn\"" Jul 09 15:26:19.658741 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.658723 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:19.658827 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.658796 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:19.659585 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.659549 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.661120 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.660237 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661232 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661295 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661306 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661317 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-btbkq\"" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661354 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 15:26:19.661644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661232 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.662072 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.661951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.662796 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.662776 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 15:26:19.663215 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.663088 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 15:26:19.663423 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.663401 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zdkwv\"" Jul 09 15:26:19.663647 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.663628 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.663731 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.663704 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:19.664078 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.664059 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 15:26:19.664176 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.664121 2581 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 15:26:19.664330 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.664308 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.665465 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.665441 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.665587 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.665557 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.665979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.665959 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-bsmnw\"" Jul 09 15:26:19.669184 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.667868 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.669387 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.669367 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.669531 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.669459 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:19.670967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.670946 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kg8jv\"" Jul 09 15:26:19.671094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.670979 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 15:26:19.671094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671042 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 15:26:19.671228 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671205 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 15:26:19.671289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671260 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.671485 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671467 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-k949c\"" Jul 09 15:26:19.671586 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671524 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 15:26:19.671586 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.671560 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.672830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.672808 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.674482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.674464 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.674994 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.674974 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.675398 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.675129 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-v7bjn\"" Jul 09 15:26:19.675398 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.675245 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.677043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677024 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 15:26:19.677121 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677043 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 15:26:19.677162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677043 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03b2e543-08ea-4c0d-82fe-29a17633aa2a-host-slash\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.677162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677133 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-gh52c\"" Jul 09 15:26:19.677227 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677161 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677227 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677195 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-bin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677222 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-multus-certs\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677250 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-conf\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.677289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-systemd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677381 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677301 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677381 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7x4lm\" (UniqueName: \"kubernetes.io/projected/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kube-api-access-7x4lm\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.677381 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677352 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-var-lib-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677501 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677385 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-socket-dir-parent\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677501 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677415 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-kubernetes\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.677501 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677441 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-ovn\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677501 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677465 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-config\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677536 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-socket-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677562 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-kubelet\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-node-log\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677623 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677643 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/b120a32e-2bc2-40d4-a794-cec93901fb13-kube-api-access-5m7vh\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677670 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-device-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677703 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cnibin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677744 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-etc-kubernetes\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677783 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzqk2\" (UniqueName: \"kubernetes.io/projected/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-kube-api-access-fzqk2\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677827 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-netd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-script-lib\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.677941 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1899388c-7f31-4ebd-b4bd-2e2fc6137872-konnectivity-ca\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-conf-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.677983 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-host\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-dbus\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678031 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdrvb\" (UniqueName: \"kubernetes.io/projected/03b2e543-08ea-4c0d-82fe-29a17633aa2a-kube-api-access-vdrvb\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678065 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b120a32e-2bc2-40d4-a794-cec93901fb13-ovn-node-metrics-cert\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678151 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678177 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cni-binary-copy\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678203 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-daemon-config\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysconfig\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678273 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678263 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678298 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-system-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678326 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-os-release\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678351 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-hostroot\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678398 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-systemd\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678422 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-run\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678447 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678483 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-systemd-units\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678534 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-netns\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678558 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-tuned\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678583 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-kubelet\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678608 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-bin\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678632 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-registration-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678657 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678683 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-k8s-cni-cncf-io\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.678786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678708 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcztv\" (UniqueName: \"kubernetes.io/projected/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-kube-api-access-lcztv\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678734 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678770 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-modprobe-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678792 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-tmp\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678817 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-kubelet-config\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678841 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-sys-fs\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678865 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-multus\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678888 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-netns\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678923 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-etc-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678947 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-log-socket\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.678979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-env-overrides\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1899388c-7f31-4ebd-b4bd-2e2fc6137872-agent-certs\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679044 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-sys\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679080 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-var-lib-kubelet\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679101 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-slash\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679119 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-lib-modules\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.679600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.679146 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03b2e543-08ea-4c0d-82fe-29a17633aa2a-iptables-alerter-script\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.682682 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.682660 2581 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 15:26:19.713842 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.713813 2581 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-vt8b9" Jul 09 15:26:19.722500 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.722473 2581 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-vt8b9" Jul 09 15:26:19.766229 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.766199 2581 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 15:26:19.779808 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779768 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-host\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.779808 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779810 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-dbus\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779831 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdrvb\" (UniqueName: \"kubernetes.io/projected/03b2e543-08ea-4c0d-82fe-29a17633aa2a-kube-api-access-vdrvb\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b120a32e-2bc2-40d4-a794-cec93901fb13-ovn-node-metrics-cert\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779914 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779926 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-host\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.779935 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cni-binary-copy\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780003 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-daemon-config\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780018 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-dbus\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.780043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780036 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-cnibin\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780065 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysconfig\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-system-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780151 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-os-release\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780175 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-hostroot\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780200 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780225 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-hosts-file\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780253 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-tmp-dir\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780300 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780328 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-systemd\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780353 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-run\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780379 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780409 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-systemd-units\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780434 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-netns\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.780463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780461 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwmcj\" (UniqueName: \"kubernetes.io/projected/06421120-f8ab-418a-aaa7-7732cb928eb8-kube-api-access-jwmcj\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780493 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-tuned\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-kubelet\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780544 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-bin\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780591 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-registration-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-daemon-config\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cni-binary-copy\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780617 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-k8s-cni-cncf-io\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780668 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06421120-f8ab-418a-aaa7-7732cb928eb8-host\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780702 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-systemd\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780712 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcztv\" (UniqueName: \"kubernetes.io/projected/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-kube-api-access-lcztv\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780772 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysconfig\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780771 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780814 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780820 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780842 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7z8lc\" (UniqueName: \"kubernetes.io/projected/0967d262-954b-4f7b-950d-aa7c92d0760c-kube-api-access-7z8lc\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.781238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780870 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddrmf\" (UniqueName: \"kubernetes.io/projected/0a43e8b8-053d-462f-b5fd-d1884a6cce39-kube-api-access-ddrmf\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780879 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-run\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-modprobe-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.780973 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.780971 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-tmp\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.781044 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:20.281022677 +0000 UTC m=+2.996300208 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-kubelet-config\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781230 2581 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781342 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-modprobe-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781328 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-system-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781387 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-netns\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-os-release\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781448 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-hostroot\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781484 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-sys-fs\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781541 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-multus\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781570 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-netns\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781596 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-etc-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781625 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-log-socket\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.782128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781649 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-env-overrides\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781680 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1899388c-7f31-4ebd-b4bd-2e2fc6137872-agent-certs\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781710 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-sys\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781765 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-var-lib-kubelet\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781790 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-slash\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781815 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-lib-modules\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781843 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03b2e543-08ea-4c0d-82fe-29a17633aa2a-iptables-alerter-script\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781915 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-kubelet-config\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781955 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-bin\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781964 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-lib-modules\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.781992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-log-socket\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782025 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-cni-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782027 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-k8s-cni-cncf-io\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782061 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-systemd-units\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782102 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-sys\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782114 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-d\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03b2e543-08ea-4c0d-82fe-29a17633aa2a-host-slash\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.783044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782179 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-sys-fs\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782204 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782217 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-multus\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782256 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-slash\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782329 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-kubelet\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782349 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-etc-selinux\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782331 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/03b2e543-08ea-4c0d-82fe-29a17633aa2a-host-slash\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.783864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.782375 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-ovn-kubernetes\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.785394 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/03b2e543-08ea-4c0d-82fe-29a17633aa2a-iptables-alerter-script\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.785551 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-registration-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.785684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785664 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-tmp\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.785747 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785677 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-os-release\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.785801 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785756 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-run-netns\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.785853 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785804 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-var-lib-kubelet\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.785952 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785883 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-bin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.785952 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785936 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-multus-certs\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.786046 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.785966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-conf\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.786046 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786022 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-systemd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786142 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786058 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786142 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7x4lm\" (UniqueName: \"kubernetes.io/projected/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kube-api-access-7x4lm\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.786238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786162 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-var-lib-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786216 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-env-overrides\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786272 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-cni-bin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.786331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-socket-dir-parent\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.786331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-run-multus-certs\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.786477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786332 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.786477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786355 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-systemd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786379 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2ssh4\" (UniqueName: \"kubernetes.io/projected/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-kube-api-access-2ssh4\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.786477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786401 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-etc-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786443 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-var-lib-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786510 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-openvswitch\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786515 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-sysctl-conf\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786606 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-socket-dir-parent\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786650 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-kubernetes\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-ovn\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.786734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-config\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786789 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-socket-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.787017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786826 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-kubelet\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.787017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786864 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-system-cni-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.787017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786902 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-node-log\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.786960 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-run-ovn\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787510 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787487 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-config\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787629 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787598 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-kubernetes\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.787707 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787668 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/b120a32e-2bc2-40d4-a794-cec93901fb13-kube-api-access-5m7vh\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787756 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787709 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-device-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.787756 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787740 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cnibin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.787851 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787777 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-etc-kubernetes\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.787851 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787814 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzqk2\" (UniqueName: \"kubernetes.io/projected/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-kube-api-access-fzqk2\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.787950 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-netd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.787998 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-script-lib\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.788049 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.787993 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.788049 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788026 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.788146 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788062 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06421120-f8ab-418a-aaa7-7732cb928eb8-serviceca\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.788146 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788106 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1899388c-7f31-4ebd-b4bd-2e2fc6137872-konnectivity-ca\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.788245 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788147 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-conf-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.788293 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788283 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-multus-conf-dir\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.788688 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-node-log\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.788813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788789 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-socket-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.788813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-host-var-lib-kubelet\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.788895 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788850 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/b120a32e-2bc2-40d4-a794-cec93901fb13-host-cni-netd\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.788950 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.788929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/b120a32e-2bc2-40d4-a794-cec93901fb13-ovn-node-metrics-cert\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.789336 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789314 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kubelet-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.789336 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789319 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-etc-tuned\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.789459 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789380 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-device-dir\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.789459 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789396 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-cnibin\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.789459 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/b120a32e-2bc2-40d4-a794-cec93901fb13-ovnkube-script-lib\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.789716 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789471 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-etc-kubernetes\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.791997 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.789907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/1899388c-7f31-4ebd-b4bd-2e2fc6137872-konnectivity-ca\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.792091 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.792045 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:19.792091 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.792063 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:19.792091 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.792076 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:19.792202 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.792158 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:20.29214275 +0000 UTC m=+3.007420250 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:19.793061 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.792927 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/1899388c-7f31-4ebd-b4bd-2e2fc6137872-agent-certs\") pod \"konnectivity-agent-hzct9\" (UID: \"1899388c-7f31-4ebd-b4bd-2e2fc6137872\") " pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:19.795201 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.795178 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdrvb\" (UniqueName: \"kubernetes.io/projected/03b2e543-08ea-4c0d-82fe-29a17633aa2a-kube-api-access-vdrvb\") pod \"iptables-alerter-xn4q5\" (UID: \"03b2e543-08ea-4c0d-82fe-29a17633aa2a\") " pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.796118 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.796092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7x4lm\" (UniqueName: \"kubernetes.io/projected/fd4d39ff-ac97-4252-a10f-f578ee9e8b3e-kube-api-access-7x4lm\") pod \"aws-ebs-csi-driver-node-2vwcj\" (UID: \"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:19.798073 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.798052 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzqk2\" (UniqueName: \"kubernetes.io/projected/a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e-kube-api-access-fzqk2\") pod \"multus-6jmlt\" (UID: \"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e\") " pod="openshift-multus/multus-6jmlt" Jul 09 15:26:19.798234 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.798218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5m7vh\" (UniqueName: \"kubernetes.io/projected/b120a32e-2bc2-40d4-a794-cec93901fb13-kube-api-access-5m7vh\") pod \"ovnkube-node-rffnq\" (UID: \"b120a32e-2bc2-40d4-a794-cec93901fb13\") " pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.801280 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.801230 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcztv\" (UniqueName: \"kubernetes.io/projected/f0c5f74f-278b-48b0-96ee-9a5e360f6e0d-kube-api-access-lcztv\") pod \"tuned-vz5jv\" (UID: \"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d\") " pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.811563 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.811493 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" event={"ID":"5194c3f0f86f0f687ce0565b6dadc74e","Type":"ContainerStarted","Data":"0f8fb9c45316a96369fec6217520cb34b06697b1f1d75cdeda510bb0d5507bd6"} Jul 09 15:26:19.831978 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:19.831952 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50435ba66f3042ab3dfd2a2a1f355d26.slice/crio-d7527d5c690f0af8aed5b38b81373bd620bb7c4068f96a73ceafbf178f0a1d1e WatchSource:0}: Error finding container d7527d5c690f0af8aed5b38b81373bd620bb7c4068f96a73ceafbf178f0a1d1e: Status 404 returned error can't find the container with id d7527d5c690f0af8aed5b38b81373bd620bb7c4068f96a73ceafbf178f0a1d1e Jul 09 15:26:19.888668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888529 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888602 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-os-release\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888643 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888670 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2ssh4\" (UniqueName: \"kubernetes.io/projected/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-kube-api-access-2ssh4\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888699 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-system-cni-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888732 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888751 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-os-release\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888757 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06421120-f8ab-418a-aaa7-7732cb928eb8-serviceca\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888834 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-cnibin\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.888904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888880 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-hosts-file\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888933 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-tmp-dir\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.888973 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwmcj\" (UniqueName: \"kubernetes.io/projected/06421120-f8ab-418a-aaa7-7732cb928eb8-kube-api-access-jwmcj\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889004 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06421120-f8ab-418a-aaa7-7732cb928eb8-host\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889031 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889063 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7z8lc\" (UniqueName: \"kubernetes.io/projected/0967d262-954b-4f7b-950d-aa7c92d0760c-kube-api-access-7z8lc\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889091 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddrmf\" (UniqueName: \"kubernetes.io/projected/0a43e8b8-053d-462f-b5fd-d1884a6cce39-kube-api-access-ddrmf\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889250 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/06421120-f8ab-418a-aaa7-7732cb928eb8-serviceca\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.889268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889257 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.889727 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.889354 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:19.889727 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:19.889427 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:20.389406011 +0000 UTC m=+3.104683511 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:19.889727 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889524 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-tmp-dir\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.889727 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-cnibin\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.889727 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/06421120-f8ab-418a-aaa7-7732cb928eb8-host\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.890002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889746 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-system-cni-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.890002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889748 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/0967d262-954b-4f7b-950d-aa7c92d0760c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.890002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.889793 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-hosts-file\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.890163 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.890092 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.890274 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.890246 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/0967d262-954b-4f7b-950d-aa7c92d0760c-cni-binary-copy\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.900719 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.900637 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddrmf\" (UniqueName: \"kubernetes.io/projected/0a43e8b8-053d-462f-b5fd-d1884a6cce39-kube-api-access-ddrmf\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:19.903631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.903604 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwmcj\" (UniqueName: \"kubernetes.io/projected/06421120-f8ab-418a-aaa7-7732cb928eb8-kube-api-access-jwmcj\") pod \"node-ca-pzrzd\" (UID: \"06421120-f8ab-418a-aaa7-7732cb928eb8\") " pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:19.905501 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.905470 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7z8lc\" (UniqueName: \"kubernetes.io/projected/0967d262-954b-4f7b-950d-aa7c92d0760c-kube-api-access-7z8lc\") pod \"multus-additional-cni-plugins-5jkkd\" (UID: \"0967d262-954b-4f7b-950d-aa7c92d0760c\") " pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:19.906552 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.906528 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2ssh4\" (UniqueName: \"kubernetes.io/projected/ffe1d3d8-2b8a-42e5-bb66-dd873a15c694-kube-api-access-2ssh4\") pod \"node-resolver-9h98t\" (UID: \"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694\") " pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:19.969010 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.968968 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" Jul 09 15:26:19.977338 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.977299 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-xn4q5" Jul 09 15:26:19.986512 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.986481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:19.993655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:19.993629 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:20.001433 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.001413 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" Jul 09 15:26:20.008247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.008221 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-6jmlt" Jul 09 15:26:20.015083 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.015063 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" Jul 09 15:26:20.021807 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.021785 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9h98t" Jul 09 15:26:20.028614 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.028592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-pzrzd" Jul 09 15:26:20.292327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.292245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:20.292327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.292285 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:20.292544 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292416 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:20.292544 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292419 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:20.292544 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292511 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.292490468 +0000 UTC m=+4.007767967 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:20.292544 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292433 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:20.292544 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292541 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:20.292806 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.292607 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.292587179 +0000 UTC m=+4.007864677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:20.393420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.393375 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:20.393617 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.393590 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:20.393694 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.393682 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:21.393659812 +0000 UTC m=+4.108937311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:20.581924 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.581886 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb120a32e_2bc2_40d4_a794_cec93901fb13.slice/crio-9ce42987877a73b885c844479b4cc794b6558bc7c565bcce2379399cbdcb5fd5 WatchSource:0}: Error finding container 9ce42987877a73b885c844479b4cc794b6558bc7c565bcce2379399cbdcb5fd5: Status 404 returned error can't find the container with id 9ce42987877a73b885c844479b4cc794b6558bc7c565bcce2379399cbdcb5fd5 Jul 09 15:26:20.585770 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.585741 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1899388c_7f31_4ebd_b4bd_2e2fc6137872.slice/crio-faf6450355e008699c08ad2723f22c817f161b53ee96bdc54073d6e548ab7e20 WatchSource:0}: Error finding container faf6450355e008699c08ad2723f22c817f161b53ee96bdc54073d6e548ab7e20: Status 404 returned error can't find the container with id faf6450355e008699c08ad2723f22c817f161b53ee96bdc54073d6e548ab7e20 Jul 09 15:26:20.589093 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.589063 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod06421120_f8ab_418a_aaa7_7732cb928eb8.slice/crio-1f21e33165c5be6a03e2f18658f96b9373b6876be3c62dd3acb9dee6033380d6 WatchSource:0}: Error finding container 1f21e33165c5be6a03e2f18658f96b9373b6876be3c62dd3acb9dee6033380d6: Status 404 returned error can't find the container with id 1f21e33165c5be6a03e2f18658f96b9373b6876be3c62dd3acb9dee6033380d6 Jul 09 15:26:20.589871 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.589845 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03b2e543_08ea_4c0d_82fe_29a17633aa2a.slice/crio-96eee8003c5bf3a1a872384dfb209428b5cbe9c8e1651e3c44edeab576191fc6 WatchSource:0}: Error finding container 96eee8003c5bf3a1a872384dfb209428b5cbe9c8e1651e3c44edeab576191fc6: Status 404 returned error can't find the container with id 96eee8003c5bf3a1a872384dfb209428b5cbe9c8e1651e3c44edeab576191fc6 Jul 09 15:26:20.591395 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.590982 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0f34d8e_300f_42ad_b4b1_6e4a52ddb61e.slice/crio-1580df8a62075bafebb55cf656e8798af5406cf04a7ef1a7131f113a5424b722 WatchSource:0}: Error finding container 1580df8a62075bafebb55cf656e8798af5406cf04a7ef1a7131f113a5424b722: Status 404 returned error can't find the container with id 1580df8a62075bafebb55cf656e8798af5406cf04a7ef1a7131f113a5424b722 Jul 09 15:26:20.599561 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:20.599512 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffe1d3d8_2b8a_42e5_bb66_dd873a15c694.slice/crio-c70f02b1e6d587185cdbf02105c2c0c679ccde500aa18346b3785f3b9b9ff238 WatchSource:0}: Error finding container c70f02b1e6d587185cdbf02105c2c0c679ccde500aa18346b3785f3b9b9ff238: Status 404 returned error can't find the container with id c70f02b1e6d587185cdbf02105c2c0c679ccde500aa18346b3785f3b9b9ff238 Jul 09 15:26:20.725060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.724743 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:20 +0000 UTC" deadline="2028-03-07 11:14:57.147053873 +0000 UTC" Jul 09 15:26:20.725060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.725050 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14563h48m36.422010039s" Jul 09 15:26:20.807985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.807948 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:20.808162 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:20.808098 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:20.814915 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.814873 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9h98t" event={"ID":"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694","Type":"ContainerStarted","Data":"c70f02b1e6d587185cdbf02105c2c0c679ccde500aa18346b3785f3b9b9ff238"} Jul 09 15:26:20.816257 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.816148 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" event={"ID":"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e","Type":"ContainerStarted","Data":"5fc8b3d952839ebc7192ad8cca37036e8bcb0c054af5e6a8388db91520afaa1f"} Jul 09 15:26:20.817575 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.817539 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" event={"ID":"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d","Type":"ContainerStarted","Data":"8e985e9fca556db492a57b7aea0a3803b7cab83b8ebffb5f1e5293fb544dc05a"} Jul 09 15:26:20.818867 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.818842 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pzrzd" event={"ID":"06421120-f8ab-418a-aaa7-7732cb928eb8","Type":"ContainerStarted","Data":"1f21e33165c5be6a03e2f18658f96b9373b6876be3c62dd3acb9dee6033380d6"} Jul 09 15:26:20.819913 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.819883 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hzct9" event={"ID":"1899388c-7f31-4ebd-b4bd-2e2fc6137872","Type":"ContainerStarted","Data":"faf6450355e008699c08ad2723f22c817f161b53ee96bdc54073d6e548ab7e20"} Jul 09 15:26:20.821144 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.821120 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"9ce42987877a73b885c844479b4cc794b6558bc7c565bcce2379399cbdcb5fd5"} Jul 09 15:26:20.822403 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.822383 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" event={"ID":"50435ba66f3042ab3dfd2a2a1f355d26","Type":"ContainerStarted","Data":"d7527d5c690f0af8aed5b38b81373bd620bb7c4068f96a73ceafbf178f0a1d1e"} Jul 09 15:26:20.825721 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.825149 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" event={"ID":"5194c3f0f86f0f687ce0565b6dadc74e","Type":"ContainerStarted","Data":"9533e141605fa9f813e899aa7b67a901816311d8123de35277ffcc8c07e69632"} Jul 09 15:26:20.827419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.827396 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerStarted","Data":"59debf4710a634a4678bd67c9f9993dc44065a3c22b0bd436a9bf457c8178a7e"} Jul 09 15:26:20.828565 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.828544 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jmlt" event={"ID":"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e","Type":"ContainerStarted","Data":"1580df8a62075bafebb55cf656e8798af5406cf04a7ef1a7131f113a5424b722"} Jul 09 15:26:20.829837 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:20.829813 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xn4q5" event={"ID":"03b2e543-08ea-4c0d-82fe-29a17633aa2a","Type":"ContainerStarted","Data":"96eee8003c5bf3a1a872384dfb209428b5cbe9c8e1651e3c44edeab576191fc6"} Jul 09 15:26:21.300656 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.300538 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:21.300656 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.300601 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:21.300893 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300781 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:21.300893 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300802 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:21.300893 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300816 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.300893 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300880 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:23.300858315 +0000 UTC m=+6.016135814 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:21.301214 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300961 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.301214 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.300997 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:23.300986081 +0000 UTC m=+6.016263580 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:21.402444 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.401793 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:21.402444 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.402012 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.402444 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.402082 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:23.402060896 +0000 UTC m=+6.117338395 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:21.725661 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.725538 2581 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 15:21:20 +0000 UTC" deadline="2028-02-04 12:47:50.06594301 +0000 UTC" Jul 09 15:26:21.725661 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.725601 2581 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13797h21m28.340347595s" Jul 09 15:26:21.808750 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.808719 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:21.808750 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:21.808740 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:21.809004 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.808868 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:21.809004 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:21.808979 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:22.807944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:22.807538 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:22.807944 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:22.807707 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:23.319906 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.319864 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:23.320091 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.319923 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:23.320179 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320103 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:23.320179 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320125 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:23.320179 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320138 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:23.320323 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320203 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:27.320183678 +0000 UTC m=+10.035461176 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:23.320773 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320745 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:23.320899 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.320818 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:27.320801672 +0000 UTC m=+10.036079168 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:23.421098 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.420492 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:23.421098 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.420671 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:23.421098 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.420752 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:27.42072967 +0000 UTC m=+10.136007167 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:23.808775 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.808680 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:23.809234 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.808823 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:23.809234 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.808687 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:23.809334 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:23.809265 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:23.843439 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.843397 2581 generic.go:356] "Generic (PLEG): container finished" podID="50435ba66f3042ab3dfd2a2a1f355d26" containerID="be4bf63bd68697a628069e9125e64e006dc3b77c92e3c5fe72dbbe276311cc87" exitCode=0 Jul 09 15:26:23.843701 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.843460 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" event={"ID":"50435ba66f3042ab3dfd2a2a1f355d26","Type":"ContainerDied","Data":"be4bf63bd68697a628069e9125e64e006dc3b77c92e3c5fe72dbbe276311cc87"} Jul 09 15:26:23.868911 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:23.868845 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-130-22.ec2.internal" podStartSLOduration=3.868822924 podStartE2EDuration="3.868822924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:20.86870555 +0000 UTC m=+3.583983070" watchObservedRunningTime="2026-07-09 15:26:23.868822924 +0000 UTC m=+6.584100446" Jul 09 15:26:24.808060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:24.808022 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:24.808282 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:24.808175 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:25.809331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:25.808757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:25.809331 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:25.808862 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:25.809331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:25.809223 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:25.809331 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:25.809297 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:26.807676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:26.807634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:26.807875 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:26.807804 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:27.355399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:27.355355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:27.355414 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355625 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355651 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355667 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355733 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.355715802 +0000 UTC m=+18.070993298 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355805 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:27.355921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.355831 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.355823113 +0000 UTC m=+18.071100610 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:27.456470 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:27.456431 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:27.456677 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.456628 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:27.456742 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.456706 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:35.456685016 +0000 UTC m=+18.171962526 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:27.808000 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:27.807957 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:27.808188 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.808073 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:27.808188 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:27.808124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:27.808323 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:27.808260 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:28.807733 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:28.807688 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:28.808261 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:28.807865 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:29.809578 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:29.807475 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:29.809578 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:29.807619 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:29.809578 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:29.807960 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:29.809578 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:29.808047 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:30.807796 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:30.807752 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:30.807980 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:30.807922 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:31.810662 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:31.810634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:31.811027 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:31.810748 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:31.811027 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:31.810634 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:31.811027 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:31.810833 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:32.808000 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:32.807963 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:32.808164 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:32.808118 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:33.808082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:33.808045 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:33.808464 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:33.808049 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:33.808464 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:33.808162 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:33.808464 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:33.808238 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:34.808101 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:34.808059 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:34.808454 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:34.808210 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:35.412605 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:35.412566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:35.412605 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:35.412612 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:35.412799 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412725 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:35.412799 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412739 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:35.412799 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412756 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:35.412799 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412765 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:35.412799 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412789 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:51.412774626 +0000 UTC m=+34.128052124 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:35.412977 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.412808 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:51.412795499 +0000 UTC m=+34.128072998 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:35.513228 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:35.513178 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:35.513397 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.513334 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:35.513454 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.513399 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:51.513380479 +0000 UTC m=+34.228657995 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:35.807344 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:35.807259 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:35.807344 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:35.807266 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:35.807542 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.807428 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:35.807584 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:35.807562 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:36.808056 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:36.808014 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:36.808550 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:36.808148 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:37.810473 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:37.810440 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:37.810473 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:37.810455 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:37.810962 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:37.810576 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:37.810962 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:37.810732 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:38.807990 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:38.807951 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:38.808185 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:38.808108 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:39.808169 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:39.808124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:39.808756 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:39.808124 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:39.808756 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:39.808284 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:39.808756 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:39.808668 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:40.807410 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.807236 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:40.807601 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:40.807507 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:40.879442 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.879219 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:26:40.880108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.879797 2581 generic.go:356] "Generic (PLEG): container finished" podID="b120a32e-2bc2-40d4-a794-cec93901fb13" containerID="b865d6f9a3104979dd1aa6c47f477cdf0ca2188ad3bb7a75475de43eee110c51" exitCode=1 Jul 09 15:26:40.880108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.879862 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"50b2d154e27dda0f29e1ed0855801e93dd55946f0282860ad1c06b6b72206cdc"} Jul 09 15:26:40.880108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.879944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"de51ae071745ae1b4ba2c052038eb4acb7b90ab8710ddb0ac0fb7be6e281a013"} Jul 09 15:26:40.880108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.879995 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerDied","Data":"b865d6f9a3104979dd1aa6c47f477cdf0ca2188ad3bb7a75475de43eee110c51"} Jul 09 15:26:40.880108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.880043 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"8c33d103ddb4589f0ddfa91e05f0a5f9c1c21307cb59ddbf057b0ae2d383d180"} Jul 09 15:26:40.881372 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.881351 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" event={"ID":"50435ba66f3042ab3dfd2a2a1f355d26","Type":"ContainerStarted","Data":"1bdcf3dcc4ad260796da3c268c6afabfb32bdf3803714f743f521b38ead763e7"} Jul 09 15:26:40.882787 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.882765 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="94ee2311a67a0b2c3dc5a35ae0d219df8c5e3377b84e663bc8530cd0962f5a25" exitCode=0 Jul 09 15:26:40.882870 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.882849 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"94ee2311a67a0b2c3dc5a35ae0d219df8c5e3377b84e663bc8530cd0962f5a25"} Jul 09 15:26:40.884268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.884250 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-6jmlt" event={"ID":"a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e","Type":"ContainerStarted","Data":"8d466695ecd2a782bed1b34ca52287f28a661db8e2c8d4cd335b36dc95e3f21d"} Jul 09 15:26:40.885586 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.885545 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9h98t" event={"ID":"ffe1d3d8-2b8a-42e5-bb66-dd873a15c694","Type":"ContainerStarted","Data":"f874ac4242996ef8003ecd72981fb90a852ee44b2719ca9a21b478c941f04715"} Jul 09 15:26:40.886917 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.886899 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" event={"ID":"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e","Type":"ContainerStarted","Data":"99fca71ebf5881b76f177579dd68f4a62c1bdf493d417d8c5547eebe4f6b4e69"} Jul 09 15:26:40.891183 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.891155 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" event={"ID":"f0c5f74f-278b-48b0-96ee-9a5e360f6e0d","Type":"ContainerStarted","Data":"a5d19d29d7a861c747554c2aa96ad6ceac5b5b4195c5fb710f7ae7443eadaed2"} Jul 09 15:26:40.892520 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.892481 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-pzrzd" event={"ID":"06421120-f8ab-418a-aaa7-7732cb928eb8","Type":"ContainerStarted","Data":"d71003dd99a143e88ad6a8c724eee9a25ec8ddb8d1c9f77386da02f1802c8432"} Jul 09 15:26:40.893707 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.893687 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hzct9" event={"ID":"1899388c-7f31-4ebd-b4bd-2e2fc6137872","Type":"ContainerStarted","Data":"8ffeea4ee1cacdc9d2452d1ba342c80174a4ff168c6581e0951d27919db001fb"} Jul 09 15:26:40.921274 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.921237 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-130-22.ec2.internal" podStartSLOduration=20.921221818 podStartE2EDuration="20.921221818s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.901938321 +0000 UTC m=+23.617215839" watchObservedRunningTime="2026-07-09 15:26:40.921221818 +0000 UTC m=+23.636499334" Jul 09 15:26:40.921544 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.921519 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-pzrzd" podStartSLOduration=10.752099634 podStartE2EDuration="21.921514078s" totalImagesPullingTime="11.169414444s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.921153283 +0000 UTC m=+23.636430798" watchObservedRunningTime="2026-07-09 15:26:40.921514078 +0000 UTC m=+23.636791614" Jul 09 15:26:40.938624 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.938580 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hzct9" podStartSLOduration=3.302021039 podStartE2EDuration="22.938562502s" totalImagesPullingTime="19.636541463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.938293399 +0000 UTC m=+23.653570917" watchObservedRunningTime="2026-07-09 15:26:40.938562502 +0000 UTC m=+23.653840018" Jul 09 15:26:40.957856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:40.957765 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-6jmlt" podStartSLOduration=2.280038748 podStartE2EDuration="21.957750141s" totalImagesPullingTime="19.677711393s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.957491282 +0000 UTC m=+23.672768799" watchObservedRunningTime="2026-07-09 15:26:40.957750141 +0000 UTC m=+23.673027658" Jul 09 15:26:41.006006 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.005964 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-vz5jv" podStartSLOduration=3.361104648 podStartE2EDuration="23.005947407s" totalImagesPullingTime="19.644842759s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:40.979786239 +0000 UTC m=+23.695063752" watchObservedRunningTime="2026-07-09 15:26:41.005947407 +0000 UTC m=+23.721224926" Jul 09 15:26:41.024871 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.024824 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9h98t" podStartSLOduration=2.400376826 podStartE2EDuration="22.024805485s" totalImagesPullingTime="19.624428659s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:41.024569012 +0000 UTC m=+23.739846529" watchObservedRunningTime="2026-07-09 15:26:41.024805485 +0000 UTC m=+23.740083003" Jul 09 15:26:41.736675 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.736435 2581 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 15:26:41.807563 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.807530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:41.807745 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.807530 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:41.807745 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:41.807656 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:41.807850 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:41.807743 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:41.899758 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.899732 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:26:41.900228 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.900197 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"5586242acbd8ce6c0f9b36277c7827f63a45102f85430acae4bb1a5be8ac05f7"} Jul 09 15:26:41.900311 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.900290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"7d48d3c92921b4096ab848d33de7e4e62d42a582af35ef08ae4a10326f12735d"} Jul 09 15:26:41.901662 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.901629 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-xn4q5" event={"ID":"03b2e543-08ea-4c0d-82fe-29a17633aa2a","Type":"ContainerStarted","Data":"9d0e7848dc897726ca5ecc4dd61659e84d58bea14da8b0557cc04032dacbea44"} Jul 09 15:26:41.903539 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.903487 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" event={"ID":"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e","Type":"ContainerStarted","Data":"df707d29c99f9d42e59d98719c6e9648c6428729b91dbc9021f2c0f3fcfbcca0"} Jul 09 15:26:41.918444 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:41.918389 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-xn4q5" podStartSLOduration=4.31281566 podStartE2EDuration="23.918367475s" totalImagesPullingTime="19.605551815s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:41.917814508 +0000 UTC m=+24.633092025" watchObservedRunningTime="2026-07-09 15:26:41.918367475 +0000 UTC m=+24.633644994" Jul 09 15:26:42.735288 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:42.735166 2581 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T15:26:41.736458392Z","UUID":"62249bf4-8a81-4c1a-b67b-79c074fee50b","Handler":null,"Name":"","Endpoint":""} Jul 09 15:26:42.737343 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:42.737302 2581 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 15:26:42.737489 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:42.737418 2581 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 15:26:42.807541 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:42.807486 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:42.807706 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:42.807659 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:42.908551 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:42.908514 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" event={"ID":"fd4d39ff-ac97-4252-a10f-f578ee9e8b3e","Type":"ContainerStarted","Data":"2cb30464e58f07f304857bcf4ee6b7ed96d676ea4a74397208b3f820cb1789cb"} Jul 09 15:26:43.807547 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:43.807346 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:43.807737 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:43.807447 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:43.807737 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:43.807658 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:43.807849 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:43.807735 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:43.914435 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:43.914409 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:26:43.914894 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:43.914869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"a7c96cb821e9b123b7cb917795c0f9737dddf9fc6e965495fb2dc0e9e45c46bf"} Jul 09 15:26:44.267804 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.267766 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:44.268560 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.268538 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:44.285898 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.285855 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-2vwcj" podStartSLOduration=4.586231033 podStartE2EDuration="26.285839708s" totalImagesPullingTime="21.699608675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:42.93757964 +0000 UTC m=+25.652857147" watchObservedRunningTime="2026-07-09 15:26:44.285839708 +0000 UTC m=+27.001117254" Jul 09 15:26:44.808040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.808004 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:44.808250 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:44.808132 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:44.917892 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.917858 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:44.918398 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:44.918370 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hzct9" Jul 09 15:26:45.807583 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.807303 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:45.807583 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.807370 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:45.807800 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:45.807584 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:45.807800 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:45.807688 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:45.926039 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.926010 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:26:45.926830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.926395 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"99afeda5a1cbd1c79b2f177fdf9fee02d737fed46d31f8b7d62d7db9b402e9a5"} Jul 09 15:26:45.926830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.926652 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:45.926906 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.926894 2581 scope.go:117] "RemoveContainer" containerID="b865d6f9a3104979dd1aa6c47f477cdf0ca2188ad3bb7a75475de43eee110c51" Jul 09 15:26:45.928288 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.928266 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="8725c2df75af57da2866abc5c1a0febf8bf2ca1440e45c255fb4c8b8fb9ef9b5" exitCode=0 Jul 09 15:26:45.928393 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.928354 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"8725c2df75af57da2866abc5c1a0febf8bf2ca1440e45c255fb4c8b8fb9ef9b5"} Jul 09 15:26:45.943549 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:45.943530 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:46.808100 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.808065 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:46.808319 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:46.808182 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:46.934542 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.934514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:26:46.934968 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.934944 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" event={"ID":"b120a32e-2bc2-40d4-a794-cec93901fb13","Type":"ContainerStarted","Data":"fcf778676785cb4d4387a6feda157a0956adc79eb6d932d1b747093c1c3f81ed"} Jul 09 15:26:46.935056 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.935042 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:46.935310 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.935276 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:46.952403 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.952379 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:26:46.982223 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:46.982165 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" podStartSLOduration=9.316483326 podStartE2EDuration="28.982143713s" totalImagesPullingTime="19.665660387s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:46.980566766 +0000 UTC m=+29.695844284" watchObservedRunningTime="2026-07-09 15:26:46.982143713 +0000 UTC m=+29.697421232" Jul 09 15:26:47.230529 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.230461 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwhms"] Jul 09 15:26:47.230695 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.230619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:47.230741 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:47.230709 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:47.233952 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.233929 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-985tq"] Jul 09 15:26:47.234071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.234012 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:47.234113 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:47.234088 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:47.248633 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.248602 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxxwc"] Jul 09 15:26:47.248764 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.248713 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:47.248811 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:47.248798 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:47.939003 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.938971 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="97e5d7300ebdfd376ccfd921359b143340e8a0d53125d6eb764b0a500d20888b" exitCode=0 Jul 09 15:26:47.939586 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:47.939063 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"97e5d7300ebdfd376ccfd921359b143340e8a0d53125d6eb764b0a500d20888b"} Jul 09 15:26:48.807628 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:48.807541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:48.807628 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:48.807563 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:48.807821 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:48.807655 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:48.807821 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:48.807713 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:48.807821 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:48.807771 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:48.807926 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:48.807856 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:48.944371 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:48.944341 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="a4e4a7aa5bd7799843a5a7ae996f28fe6581251a6075568d2e88cfb65bc3cfcc" exitCode=0 Jul 09 15:26:48.944760 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:48.944433 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"a4e4a7aa5bd7799843a5a7ae996f28fe6581251a6075568d2e88cfb65bc3cfcc"} Jul 09 15:26:50.807745 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:50.807527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:50.808350 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:50.807527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:50.808350 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:50.807838 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:50.808350 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:50.807934 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:50.808350 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:50.807527 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:50.808350 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:50.808066 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:51.433893 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:51.433863 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:51.434071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:51.433927 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:51.434071 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434011 2581 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:51.434071 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434049 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 15:26:51.434071 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434069 2581 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 15:26:51.434220 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434080 2581 projected.go:196] Error preparing data for projected volume kube-api-access-7429h for pod openshift-network-diagnostics/network-check-target-mwhms: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:51.434220 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434059 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret podName:4c1e25b4-7f2d-48a1-a298-15ac34b188d4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:23.434045657 +0000 UTC m=+66.149323151 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret") pod "global-pull-secret-syncer-fxxwc" (UID: "4c1e25b4-7f2d-48a1-a298-15ac34b188d4") : object "kube-system"/"original-pull-secret" not registered Jul 09 15:26:51.434220 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.434146 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h podName:2552a32d-d543-4f5b-b72d-c2f93c594ce9 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:23.434134866 +0000 UTC m=+66.149412361 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7429h" (UniqueName: "kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h") pod "network-check-target-mwhms" (UID: "2552a32d-d543-4f5b-b72d-c2f93c594ce9") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 15:26:51.534427 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:51.534387 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:51.534622 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.534540 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:51.534622 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:51.534605 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:23.534590234 +0000 UTC m=+66.249867728 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 15:26:52.807571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:52.807522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:52.808038 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:52.807522 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:52.808038 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:52.807649 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:26:52.808038 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:52.807671 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:52.808038 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:52.807729 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-fxxwc" podUID="4c1e25b4-7f2d-48a1-a298-15ac34b188d4" Jul 09 15:26:52.808038 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:52.807797 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mwhms" podUID="2552a32d-d543-4f5b-b72d-c2f93c594ce9" Jul 09 15:26:53.059973 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.059898 2581 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-130-22.ec2.internal" event="NodeReady" Jul 09 15:26:53.060102 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.060020 2581 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 15:26:53.095946 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.095916 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:26:53.111781 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.111748 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.114964 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.114793 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 09 15:26:53.114964 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.114830 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 09 15:26:53.115267 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.115231 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gwbcf\"" Jul 09 15:26:53.115378 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.115232 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 09 15:26:53.116074 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.116050 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:26:53.116655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.116636 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-7drzr"] Jul 09 15:26:53.120289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.120270 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 09 15:26:53.129293 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.129267 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-pjmkc"] Jul 09 15:26:53.129399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.129365 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.133979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.133962 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 15:26:53.134082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.133984 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 15:26:53.134314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.134231 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqnp4\"" Jul 09 15:26:53.141741 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.141711 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7drzr"] Jul 09 15:26:53.141850 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.141766 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjmkc"] Jul 09 15:26:53.141903 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.141896 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.144718 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.144699 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 15:26:53.144813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.144772 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 15:26:53.144813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.144777 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-5fmlz\"" Jul 09 15:26:53.144912 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.144780 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 15:26:53.247704 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247674 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.247856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247731 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.247856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247766 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.247856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247784 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/146b723e-c41e-43d6-b087-6f8ec5802f2d-cert\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.247856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247822 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.247856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247840 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247886 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x7zrd\" (UniqueName: \"kubernetes.io/projected/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-kube-api-access-x7zrd\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247925 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7qnjx\" (UniqueName: \"kubernetes.io/projected/146b723e-c41e-43d6-b087-6f8ec5802f2d-kube-api-access-7qnjx\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247943 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-tmp-dir\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.247977 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-config-volume\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.248009 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.248036 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.248030 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.248252 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.248048 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xjhz9\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349333 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349302 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349340 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349366 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x7zrd\" (UniqueName: \"kubernetes.io/projected/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-kube-api-access-x7zrd\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349395 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7qnjx\" (UniqueName: \"kubernetes.io/projected/146b723e-c41e-43d6-b087-6f8ec5802f2d-kube-api-access-7qnjx\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-tmp-dir\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349455 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349475 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-config-volume\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349515 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.349605 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.349620 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.349683 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:26:53.849664856 +0000 UTC m=+36.564942367 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349701 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xjhz9\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.349800 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.350137 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349811 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.350137 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349839 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.350137 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.349861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/146b723e-c41e-43d6-b087-6f8ec5802f2d-cert\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.350137 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.350120 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.350311 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.350292 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-config-volume\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.350419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.350371 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-tmp-dir\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.350419 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.350395 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:53.350541 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.350427 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.350541 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.350456 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:53.850441336 +0000 UTC m=+36.565718832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:26:53.351997 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.351971 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.354931 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.354903 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.355043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.354939 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.355043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.354958 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/146b723e-c41e-43d6-b087-6f8ec5802f2d-cert\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.360882 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.360854 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x7zrd\" (UniqueName: \"kubernetes.io/projected/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-kube-api-access-x7zrd\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.361383 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.361357 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7qnjx\" (UniqueName: \"kubernetes.io/projected/146b723e-c41e-43d6-b087-6f8ec5802f2d-kube-api-access-7qnjx\") pod \"ingress-canary-pjmkc\" (UID: \"146b723e-c41e-43d6-b087-6f8ec5802f2d\") " pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.361481 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.361436 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xjhz9\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.361830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.361810 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.450356 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.450331 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-pjmkc" Jul 09 15:26:53.632481 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.632287 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-pjmkc"] Jul 09 15:26:53.635260 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:26:53.635204 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod146b723e_c41e_43d6_b087_6f8ec5802f2d.slice/crio-37425fe5a0050b5b13b9248aa8cb29e8ea0dc97574149664c5090dbe397fbed4 WatchSource:0}: Error finding container 37425fe5a0050b5b13b9248aa8cb29e8ea0dc97574149664c5090dbe397fbed4: Status 404 returned error can't find the container with id 37425fe5a0050b5b13b9248aa8cb29e8ea0dc97574149664c5090dbe397fbed4 Jul 09 15:26:53.854249 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.854159 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:53.854249 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.854199 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:53.854938 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.854312 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:26:53.854938 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.854326 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:53.854938 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.854330 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:26:53.854938 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.854376 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:54.854363248 +0000 UTC m=+37.569640743 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:26:53.854938 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:53.854388 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:26:54.854381833 +0000 UTC m=+37.569659329 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:26:53.958908 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.958877 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="146e81b6dca19f246363dadc8346ee6239913682bdff45d05395c239e162c7ea" exitCode=0 Jul 09 15:26:53.959076 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.958954 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"146e81b6dca19f246363dadc8346ee6239913682bdff45d05395c239e162c7ea"} Jul 09 15:26:53.960234 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:53.960018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjmkc" event={"ID":"146b723e-c41e-43d6-b087-6f8ec5802f2d","Type":"ContainerStarted","Data":"37425fe5a0050b5b13b9248aa8cb29e8ea0dc97574149664c5090dbe397fbed4"} Jul 09 15:26:54.807676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.807633 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:26:54.807856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.807682 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:26:54.807856 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.807757 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:26:54.810609 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.810582 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:26:54.811665 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.811642 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:26:54.811665 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.811673 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht5qx\"" Jul 09 15:26:54.811843 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.811675 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:26:54.811926 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.811908 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r8ws7\"" Jul 09 15:26:54.811926 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.811912 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:26:54.861657 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.861620 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.861677 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:54.861766 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:54.861789 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:54.861797 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:54.861927 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:26:56.861892178 +0000 UTC m=+39.577169674 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:26:54.862084 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:54.861946 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:26:56.861940346 +0000 UTC m=+39.577217840 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:26:54.966128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.966089 2581 generic.go:356] "Generic (PLEG): container finished" podID="0967d262-954b-4f7b-950d-aa7c92d0760c" containerID="9815a63a47d0865b654f988bdfb9c941fd455f088702c3ff0988d21b8fa4ea19" exitCode=0 Jul 09 15:26:54.966128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:54.966140 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerDied","Data":"9815a63a47d0865b654f988bdfb9c941fd455f088702c3ff0988d21b8fa4ea19"} Jul 09 15:26:55.972246 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:55.972206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" event={"ID":"0967d262-954b-4f7b-950d-aa7c92d0760c","Type":"ContainerStarted","Data":"ebfecf6acf1a72688f84272590c2f8d411f47939b68b890983b8b8c2e9014524"} Jul 09 15:26:56.008557 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:56.008479 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-5jkkd" podStartSLOduration=7.018796509 podStartE2EDuration="37.008456105s" totalImagesPullingTime="29.989659596s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:56.006444514 +0000 UTC m=+38.721722031" watchObservedRunningTime="2026-07-09 15:26:56.008456105 +0000 UTC m=+38.723733630" Jul 09 15:26:56.876479 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:56.876233 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:26:56.876479 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:56.876445 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:26:56.876664 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:56.876391 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:26:56.876664 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:56.876533 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:26:56.876664 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:56.876590 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:27:00.876573004 +0000 UTC m=+43.591850499 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:26:56.876664 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:56.876597 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:26:56.876664 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:26:56.876635 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:00.876624519 +0000 UTC m=+43.591902014 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:26:56.976447 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:56.976414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-pjmkc" event={"ID":"146b723e-c41e-43d6-b087-6f8ec5802f2d","Type":"ContainerStarted","Data":"b2c74259b1d376f006aaf044279208a9c0b3dfb73bdf4c323a318f63aaee17e0"} Jul 09 15:26:56.998778 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:26:56.998725 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-pjmkc" podStartSLOduration=1.025981188 podStartE2EDuration="3.998707839s" totalImagesPullingTime="2.972726651s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:26:56.996653422 +0000 UTC m=+39.711930939" watchObservedRunningTime="2026-07-09 15:26:56.998707839 +0000 UTC m=+39.713985356" Jul 09 15:27:00.910772 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:00.910734 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:00.910822 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:00.910891 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:00.910903 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:00.910917 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:00.910956 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:27:08.910942861 +0000 UTC m=+51.626220356 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:27:00.911300 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:00.910968 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:08.91096284 +0000 UTC m=+51.626240334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:27:08.969298 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:08.969254 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:27:08.969298 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:08.969299 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:27:08.969805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:08.969395 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:27:08.969805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:08.969418 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:27:08.969805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:08.969471 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.969455214 +0000 UTC m=+67.684732712 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:27:08.969805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:08.969399 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:08.969805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:08.969551 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:24.96953838 +0000 UTC m=+67.684815875 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:27:18.955668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:18.955641 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-rffnq" Jul 09 15:27:23.474157 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.474113 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:27:23.474157 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.474165 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:27:23.477387 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.477368 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 15:27:23.477453 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.477368 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 15:27:23.487528 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.487486 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 15:27:23.488920 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.488899 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4c1e25b4-7f2d-48a1-a298-15ac34b188d4-original-pull-secret\") pod \"global-pull-secret-syncer-fxxwc\" (UID: \"4c1e25b4-7f2d-48a1-a298-15ac34b188d4\") " pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:27:23.498207 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.498184 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7429h\" (UniqueName: \"kubernetes.io/projected/2552a32d-d543-4f5b-b72d-c2f93c594ce9-kube-api-access-7429h\") pod \"network-check-target-mwhms\" (UID: \"2552a32d-d543-4f5b-b72d-c2f93c594ce9\") " pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:27:23.574613 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.574580 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:27:23.577705 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.577688 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 15:27:23.585157 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:23.585138 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:27:23.585225 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:23.585215 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:28:27.585193559 +0000 UTC m=+130.300471054 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : secret "metrics-daemon-secret" not found Jul 09 15:27:23.626835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.626802 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-fxxwc" Jul 09 15:27:23.636922 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.636895 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-r8ws7\"" Jul 09 15:27:23.640564 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.640541 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:27:23.807241 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.807198 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-fxxwc"] Jul 09 15:27:23.811931 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:27:23.811903 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c1e25b4_7f2d_48a1_a298_15ac34b188d4.slice/crio-adbe113b999dfe3e3ddc6612223b77527aa8a90570ba99d1cd5833c3cebac9a5 WatchSource:0}: Error finding container adbe113b999dfe3e3ddc6612223b77527aa8a90570ba99d1cd5833c3cebac9a5: Status 404 returned error can't find the container with id adbe113b999dfe3e3ddc6612223b77527aa8a90570ba99d1cd5833c3cebac9a5 Jul 09 15:27:23.827005 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:23.826979 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mwhms"] Jul 09 15:27:23.835768 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:27:23.835742 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2552a32d_d543_4f5b_b72d_c2f93c594ce9.slice/crio-f4a638d9f71dae04ee3bec4351f53f3be811540707d55b608856a60dd69f65ec WatchSource:0}: Error finding container f4a638d9f71dae04ee3bec4351f53f3be811540707d55b608856a60dd69f65ec: Status 404 returned error can't find the container with id f4a638d9f71dae04ee3bec4351f53f3be811540707d55b608856a60dd69f65ec Jul 09 15:27:24.038287 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:24.038206 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwhms" event={"ID":"2552a32d-d543-4f5b-b72d-c2f93c594ce9","Type":"ContainerStarted","Data":"f4a638d9f71dae04ee3bec4351f53f3be811540707d55b608856a60dd69f65ec"} Jul 09 15:27:24.039277 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:24.039255 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxxwc" event={"ID":"4c1e25b4-7f2d-48a1-a298-15ac34b188d4","Type":"ContainerStarted","Data":"adbe113b999dfe3e3ddc6612223b77527aa8a90570ba99d1cd5833c3cebac9a5"} Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:24.987487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:24.987566 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:24.987637 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:24.987662 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:24.987699 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:24.987752 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:27:56.987727519 +0000 UTC m=+99.703005015 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:27:24.987758 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:24.987771 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:27:56.987762077 +0000 UTC m=+99.703039571 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:27:29.054074 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:29.054024 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mwhms" event={"ID":"2552a32d-d543-4f5b-b72d-c2f93c594ce9","Type":"ContainerStarted","Data":"c61ce51bd8fff781fd27b520c651f679330196c5f18f3f9936902b305c7a111f"} Jul 09 15:27:29.054551 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:29.054198 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:27:29.055482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:29.055462 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-fxxwc" event={"ID":"4c1e25b4-7f2d-48a1-a298-15ac34b188d4","Type":"ContainerStarted","Data":"628c997595c00d3835388835f01e3c4cea7433274a16db29a07b551b82f65b35"} Jul 09 15:27:29.079015 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:29.078970 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mwhms" podStartSLOduration=66.56466344 podStartE2EDuration="1m11.078955865s" totalImagesPullingTime="4.514292425s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:29.078485672 +0000 UTC m=+71.793763189" watchObservedRunningTime="2026-07-09 15:27:29.078955865 +0000 UTC m=+71.794233384" Jul 09 15:27:29.098148 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:29.098101 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-fxxwc" podStartSLOduration=65.556776306 podStartE2EDuration="1m10.098085915s" totalImagesPullingTime="4.541309609s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:27:29.0974544 +0000 UTC m=+71.812731908" watchObservedRunningTime="2026-07-09 15:27:29.098085915 +0000 UTC m=+71.813363431" Jul 09 15:27:57.014270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:57.014228 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:27:57.014270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:27:57.014268 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:27:57.014723 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:57.014374 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:27:57.014723 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:57.014381 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:27:57.014723 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:57.014403 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:27:57.014723 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:57.014435 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:29:01.014421491 +0000 UTC m=+163.729698986 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:27:57.014723 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:27:57.014457 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:29:01.014444347 +0000 UTC m=+163.729721841 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:28:00.060152 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:28:00.060123 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mwhms" Jul 09 15:28:27.630371 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:28:27.630322 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:28:27.630885 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:28:27.630511 2581 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 09 15:28:27.630885 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:28:27.630595 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs podName:0a43e8b8-053d-462f-b5fd-d1884a6cce39 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:29.63057862 +0000 UTC m=+252.345856118 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs") pod "network-metrics-daemon-985tq" (UID: "0a43e8b8-053d-462f-b5fd-d1884a6cce39") : secret "metrics-daemon-secret" not found Jul 09 15:28:56.122805 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:28:56.122748 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" Jul 09 15:28:56.137982 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:28:56.137943 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7drzr" podUID="5c521020-43d2-4ab5-9ecd-52f3df5ee0c4" Jul 09 15:28:56.272062 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:28:56.272031 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7drzr" Jul 09 15:28:56.272220 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:28:56.272035 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:28:57.832741 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:28:57.832693 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-985tq" podUID="0a43e8b8-053d-462f-b5fd-d1884a6cce39" Jul 09 15:29:01.056124 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:01.056077 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:29:01.056124 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:01.056125 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:29:01.056568 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:29:01.056237 2581 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 09 15:29:01.056568 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:29:01.056240 2581 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 09 15:29:01.056568 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:29:01.056260 2581 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-77c5b95f4d-6pj47: secret "image-registry-tls" not found Jul 09 15:29:01.056568 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:29:01.056314 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls podName:5c521020-43d2-4ab5-9ecd-52f3df5ee0c4 nodeName:}" failed. No retries permitted until 2026-07-09 15:31:03.056296043 +0000 UTC m=+285.771573538 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls") pod "dns-default-7drzr" (UID: "5c521020-43d2-4ab5-9ecd-52f3df5ee0c4") : secret "dns-default-metrics-tls" not found Jul 09 15:29:01.056568 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:29:01.056328 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls podName:2430e841-b3af-48dc-bc0f-1064d583ab8a nodeName:}" failed. No retries permitted until 2026-07-09 15:31:03.056321776 +0000 UTC m=+285.771599271 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls") pod "image-registry-77c5b95f4d-6pj47" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a") : secret "image-registry-tls" not found Jul 09 15:29:08.807638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:08.807542 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:29:59.933327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.933292 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82"] Jul 09 15:29:59.935128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.935111 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:29:59.939115 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.939092 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 09 15:29:59.940524 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.940480 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 15:29:59.940692 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.940598 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 15:29:59.941383 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.941366 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6"] Jul 09 15:29:59.942089 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.942070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-52szh\"" Jul 09 15:29:59.942276 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.942258 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 09 15:29:59.943334 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.943315 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jzvsg"] Jul 09 15:29:59.943422 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.943405 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:29:59.945610 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.945592 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:29:59.949971 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.949954 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 09 15:29:59.950050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950013 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 09 15:29:59.950183 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950169 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-x98gw\"" Jul 09 15:29:59.950225 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950207 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 09 15:29:59.950415 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950402 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:29:59.950452 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950438 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n9jtm\"" Jul 09 15:29:59.950712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950695 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 09 15:29:59.950825 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.950741 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 09 15:29:59.959994 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.959971 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82"] Jul 09 15:29:59.960655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.960633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6"] Jul 09 15:29:59.962843 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:29:59.962813 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jzvsg"] Jul 09 15:30:00.029797 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.029763 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8"] Jul 09 15:30:00.031708 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.031691 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" Jul 09 15:30:00.034348 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.034326 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-bhxp6\"" Jul 09 15:30:00.045136 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.045113 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8"] Jul 09 15:30:00.049146 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.049121 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7"] Jul 09 15:30:00.051090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.051072 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz"] Jul 09 15:30:00.051204 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.051189 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.053066 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.053047 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" Jul 09 15:30:00.054322 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.054305 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-lwlwm\"" Jul 09 15:30:00.054421 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.054326 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:00.054574 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.054557 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 09 15:30:00.054628 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.054562 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 09 15:30:00.055434 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.055419 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:00.055575 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.055560 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-md29z\"" Jul 09 15:30:00.055663 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.055651 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 09 15:30:00.055872 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.055860 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:00.068524 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.068480 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz"] Jul 09 15:30:00.076736 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076707 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.076849 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076743 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.076849 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076780 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.076849 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076825 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6x49k\" (UniqueName: \"kubernetes.io/projected/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-kube-api-access-6x49k\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.076945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076867 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.076945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.076945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076924 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgh84\" (UniqueName: \"kubernetes.io/projected/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-kube-api-access-qgh84\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.076945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.076942 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.079906 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.079879 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7"] Jul 09 15:30:00.178240 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178196 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6x49k\" (UniqueName: \"kubernetes.io/projected/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-kube-api-access-6x49k\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.178240 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178245 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.178446 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.178396 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:00.178479 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.178459 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.678438775 +0000 UTC m=+223.393716269 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:00.178554 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.178590 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178562 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.178638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178592 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.178638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178624 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgh84\" (UniqueName: \"kubernetes.io/projected/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-kube-api-access-qgh84\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.178736 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178655 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.178736 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178684 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.178832 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178732 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m87fv\" (UniqueName: \"kubernetes.io/projected/18ad2658-05f6-46c3-ace6-3d746b456705-kube-api-access-m87fv\") pod \"volume-data-source-validator-78495597f6-t5bkz\" (UID: \"18ad2658-05f6-46c3-ace6-3d746b456705\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" Jul 09 15:30:00.178832 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.178767 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:00.178832 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178794 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjflq\" (UniqueName: \"kubernetes.io/projected/ef9cfd4c-d86f-419f-851b-13db72def53d-kube-api-access-fjflq\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.178832 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.178825 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:00.678809756 +0000 UTC m=+223.394087270 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:00.179028 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178881 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9cfd4c-d86f-419f-851b-13db72def53d-config\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.179028 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178908 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jk6qr\" (UniqueName: \"kubernetes.io/projected/f3d0c335-3175-4e71-9b49-963ca16481cd-kube-api-access-jk6qr\") pod \"network-check-source-869dcfcdcd-nhqk8\" (UID: \"f3d0c335-3175-4e71-9b49-963ca16481cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" Jul 09 15:30:00.179028 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.178935 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9cfd4c-d86f-419f-851b-13db72def53d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.179186 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.179165 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-nginx-conf\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.179274 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.179259 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.179551 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.179530 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.181018 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.180995 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.193336 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.193265 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgh84\" (UniqueName: \"kubernetes.io/projected/2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1-kube-api-access-qgh84\") pod \"kube-storage-version-migrator-operator-799cb7f958-jcht6\" (UID: \"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.194332 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.194299 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6x49k\" (UniqueName: \"kubernetes.io/projected/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-kube-api-access-6x49k\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.252221 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.252184 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" Jul 09 15:30:00.279771 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.279737 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m87fv\" (UniqueName: \"kubernetes.io/projected/18ad2658-05f6-46c3-ace6-3d746b456705-kube-api-access-m87fv\") pod \"volume-data-source-validator-78495597f6-t5bkz\" (UID: \"18ad2658-05f6-46c3-ace6-3d746b456705\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" Jul 09 15:30:00.279771 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.279779 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjflq\" (UniqueName: \"kubernetes.io/projected/ef9cfd4c-d86f-419f-851b-13db72def53d-kube-api-access-fjflq\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.280016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.279823 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9cfd4c-d86f-419f-851b-13db72def53d-config\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.280016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.279845 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jk6qr\" (UniqueName: \"kubernetes.io/projected/f3d0c335-3175-4e71-9b49-963ca16481cd-kube-api-access-jk6qr\") pod \"network-check-source-869dcfcdcd-nhqk8\" (UID: \"f3d0c335-3175-4e71-9b49-963ca16481cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" Jul 09 15:30:00.280016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.279870 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9cfd4c-d86f-419f-851b-13db72def53d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.280554 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.280526 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/ef9cfd4c-d86f-419f-851b-13db72def53d-config\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.282330 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.282309 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/ef9cfd4c-d86f-419f-851b-13db72def53d-serving-cert\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.288635 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.288600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jk6qr\" (UniqueName: \"kubernetes.io/projected/f3d0c335-3175-4e71-9b49-963ca16481cd-kube-api-access-jk6qr\") pod \"network-check-source-869dcfcdcd-nhqk8\" (UID: \"f3d0c335-3175-4e71-9b49-963ca16481cd\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" Jul 09 15:30:00.288720 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.288707 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjflq\" (UniqueName: \"kubernetes.io/projected/ef9cfd4c-d86f-419f-851b-13db72def53d-kube-api-access-fjflq\") pod \"service-ca-operator-7695fc6c8c-2qkg7\" (UID: \"ef9cfd4c-d86f-419f-851b-13db72def53d\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.288801 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.288785 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m87fv\" (UniqueName: \"kubernetes.io/projected/18ad2658-05f6-46c3-ace6-3d746b456705-kube-api-access-m87fv\") pod \"volume-data-source-validator-78495597f6-t5bkz\" (UID: \"18ad2658-05f6-46c3-ace6-3d746b456705\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" Jul 09 15:30:00.339802 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.339772 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" Jul 09 15:30:00.361423 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.361393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" Jul 09 15:30:00.365480 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.365457 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" Jul 09 15:30:00.392778 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.392746 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6"] Jul 09 15:30:00.398949 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:00.398574 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2c0b2c8b_5d88_4be5_85a1_25ef7d54d2d1.slice/crio-21a63f893734c9c83fa14e105c999b71b5433e1219107658602eafccff735124 WatchSource:0}: Error finding container 21a63f893734c9c83fa14e105c999b71b5433e1219107658602eafccff735124: Status 404 returned error can't find the container with id 21a63f893734c9c83fa14e105c999b71b5433e1219107658602eafccff735124 Jul 09 15:30:00.426561 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.426469 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" event={"ID":"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1","Type":"ContainerStarted","Data":"21a63f893734c9c83fa14e105c999b71b5433e1219107658602eafccff735124"} Jul 09 15:30:00.496693 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:00.496655 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d0c335_3175_4e71_9b49_963ca16481cd.slice/crio-5a934cfb3b6ebb3fea608cbea25367471ed5b3216393a2c0e9af7e56293ab063 WatchSource:0}: Error finding container 5a934cfb3b6ebb3fea608cbea25367471ed5b3216393a2c0e9af7e56293ab063: Status 404 returned error can't find the container with id 5a934cfb3b6ebb3fea608cbea25367471ed5b3216393a2c0e9af7e56293ab063 Jul 09 15:30:00.498104 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.498024 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8"] Jul 09 15:30:00.516137 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.516109 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7"] Jul 09 15:30:00.524562 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:00.524534 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef9cfd4c_d86f_419f_851b_13db72def53d.slice/crio-15f9a84e89d7988b0fe7daf8b837fdef770636a275fb0c95edb6da6492ece5b1 WatchSource:0}: Error finding container 15f9a84e89d7988b0fe7daf8b837fdef770636a275fb0c95edb6da6492ece5b1: Status 404 returned error can't find the container with id 15f9a84e89d7988b0fe7daf8b837fdef770636a275fb0c95edb6da6492ece5b1 Jul 09 15:30:00.536228 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.533978 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz"] Jul 09 15:30:00.540470 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:00.540441 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18ad2658_05f6_46c3_ace6_3d746b456705.slice/crio-5db7facd7640f1c03e25be3060dd5b71d0abee34c371d1030b5c7a5bc42af300 WatchSource:0}: Error finding container 5db7facd7640f1c03e25be3060dd5b71d0abee34c371d1030b5c7a5bc42af300: Status 404 returned error can't find the container with id 5db7facd7640f1c03e25be3060dd5b71d0abee34c371d1030b5c7a5bc42af300 Jul 09 15:30:00.683746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.683703 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:00.683951 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:00.683773 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:00.683951 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.683860 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:00.683951 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.683872 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:00.683951 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.683911 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.683896832 +0000 UTC m=+224.399174327 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:00.683951 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:00.683942 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:01.683926519 +0000 UTC m=+224.399204017 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:01.430972 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.430904 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" event={"ID":"18ad2658-05f6-46c3-ace6-3d746b456705","Type":"ContainerStarted","Data":"5db7facd7640f1c03e25be3060dd5b71d0abee34c371d1030b5c7a5bc42af300"} Jul 09 15:30:01.432306 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.432276 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" event={"ID":"ef9cfd4c-d86f-419f-851b-13db72def53d","Type":"ContainerStarted","Data":"15f9a84e89d7988b0fe7daf8b837fdef770636a275fb0c95edb6da6492ece5b1"} Jul 09 15:30:01.434402 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.434360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" event={"ID":"f3d0c335-3175-4e71-9b49-963ca16481cd","Type":"ContainerStarted","Data":"18d9fca695c47938d7874cf2636c5b705da35a03f77497e53278fa6e6c1daf3d"} Jul 09 15:30:01.434506 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.434406 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" event={"ID":"f3d0c335-3175-4e71-9b49-963ca16481cd","Type":"ContainerStarted","Data":"5a934cfb3b6ebb3fea608cbea25367471ed5b3216393a2c0e9af7e56293ab063"} Jul 09 15:30:01.451204 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.451130 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-nhqk8" podStartSLOduration=1.451108636 podStartE2EDuration="1.451108636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:01.451009171 +0000 UTC m=+224.166286690" watchObservedRunningTime="2026-07-09 15:30:01.451108636 +0000 UTC m=+224.166386155" Jul 09 15:30:01.693869 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.693836 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:01.693991 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:01.693928 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:01.693991 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:01.693983 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:01.694079 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:01.694058 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.694039084 +0000 UTC m=+226.409316583 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:01.694079 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:01.694071 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:01.694194 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:01.694123 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:03.694107706 +0000 UTC m=+226.409385204 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:02.440542 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:02.440482 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" event={"ID":"18ad2658-05f6-46c3-ace6-3d746b456705","Type":"ContainerStarted","Data":"af0a53c03f6d7284fc8b6f4dce6e8c37d784b6ab58c85e0af9d652087288c7a8"} Jul 09 15:30:02.465719 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:02.465658 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-t5bkz" podStartSLOduration=1.327094563 podStartE2EDuration="2.465636488s" totalImagesPullingTime="1.138541925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:02.46469513 +0000 UTC m=+225.179972650" watchObservedRunningTime="2026-07-09 15:30:02.465636488 +0000 UTC m=+225.180914039" Jul 09 15:30:03.446804 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.446768 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" event={"ID":"ef9cfd4c-d86f-419f-851b-13db72def53d","Type":"ContainerStarted","Data":"e60b48150afcc9d4a1a91508a714d447c3a047d9015942a23953149e9f5f6beb"} Jul 09 15:30:03.448993 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.448960 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" event={"ID":"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1","Type":"ContainerStarted","Data":"992b5e740a0ab3e529b8466cb86045351a8f1500a66bf1bd1aa31a1e9ba58f55"} Jul 09 15:30:03.464877 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.464822 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" podStartSLOduration=0.633422808 podStartE2EDuration="3.46480279s" totalImagesPullingTime="2.831379982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:03.463783183 +0000 UTC m=+226.179060712" watchObservedRunningTime="2026-07-09 15:30:03.46480279 +0000 UTC m=+226.180080308" Jul 09 15:30:03.481347 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.481286 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" podStartSLOduration=1.525627551 podStartE2EDuration="4.481266562s" totalImagesPullingTime="2.955639011s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:03.480693025 +0000 UTC m=+226.195970543" watchObservedRunningTime="2026-07-09 15:30:03.481266562 +0000 UTC m=+226.196544078" Jul 09 15:30:03.712477 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.712438 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:03.712699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:03.712530 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:03.712699 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:03.712583 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:03.712699 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:03.712621 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:03.712699 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:03.712663 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.71264657 +0000 UTC m=+230.427924067 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:03.712699 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:03.712677 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:07.712670889 +0000 UTC m=+230.427948384 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:04.710089 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.710051 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx"] Jul 09 15:30:04.715885 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.715854 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" Jul 09 15:30:04.718775 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.718748 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 09 15:30:04.718917 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.718749 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-7db6w\"" Jul 09 15:30:04.719569 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.719552 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 09 15:30:04.723115 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.723094 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx"] Jul 09 15:30:04.763176 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.763140 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-28hwq"] Jul 09 15:30:04.765635 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.765613 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.769278 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.769254 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 15:30:04.769398 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.769329 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdrfs\"" Jul 09 15:30:04.769710 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.769694 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 15:30:04.769809 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.769737 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 15:30:04.770423 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.770408 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 15:30:04.785191 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.785161 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-28hwq"] Jul 09 15:30:04.819412 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.819376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rkmkp\" (UniqueName: \"kubernetes.io/projected/6bf83d60-67ec-4d9c-9981-3547a59db57f-kube-api-access-rkmkp\") pod \"migrator-7f59b54f6c-bmxqx\" (UID: \"6bf83d60-67ec-4d9c-9981-3547a59db57f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" Jul 09 15:30:04.920017 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.919962 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.920186 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.920035 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.920186 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.920067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rkmkp\" (UniqueName: \"kubernetes.io/projected/6bf83d60-67ec-4d9c-9981-3547a59db57f-kube-api-access-rkmkp\") pod \"migrator-7f59b54f6c-bmxqx\" (UID: \"6bf83d60-67ec-4d9c-9981-3547a59db57f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" Jul 09 15:30:04.920186 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.920086 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c68179-703e-46d8-ac47-95d6f55381bd-crio-socket\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.920186 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.920108 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c68179-703e-46d8-ac47-95d6f55381bd-data-volume\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.920319 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.920193 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c68bn\" (UniqueName: \"kubernetes.io/projected/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-api-access-c68bn\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:04.930799 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:04.930777 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rkmkp\" (UniqueName: \"kubernetes.io/projected/6bf83d60-67ec-4d9c-9981-3547a59db57f-kube-api-access-rkmkp\") pod \"migrator-7f59b54f6c-bmxqx\" (UID: \"6bf83d60-67ec-4d9c-9981-3547a59db57f\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" Jul 09 15:30:05.021255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021161 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c68179-703e-46d8-ac47-95d6f55381bd-data-volume\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021244 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c68bn\" (UniqueName: \"kubernetes.io/projected/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-api-access-c68bn\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021440 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021273 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021440 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021307 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021440 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021329 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c68179-703e-46d8-ac47-95d6f55381bd-crio-socket\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021440 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.021397 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:05.021440 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021417 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/b6c68179-703e-46d8-ac47-95d6f55381bd-crio-socket\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.021633 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.021439 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.021633 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.021487 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:05.52147146 +0000 UTC m=+228.236748958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : configmap "kube-rbac-proxy" not found Jul 09 15:30:05.021633 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.021524 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:05.521517377 +0000 UTC m=+228.236794872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.021633 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.021593 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/b6c68179-703e-46d8-ac47-95d6f55381bd-data-volume\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.028086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.028060 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" Jul 09 15:30:05.040818 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.040641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c68bn\" (UniqueName: \"kubernetes.io/projected/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-api-access-c68bn\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.165257 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.165181 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx"] Jul 09 15:30:05.167695 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:05.167665 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf83d60_67ec_4d9c_9981_3547a59db57f.slice/crio-6d13699aee48c51525227d474aef17c0438df1daf7dbb6a10def043cdb21bb92 WatchSource:0}: Error finding container 6d13699aee48c51525227d474aef17c0438df1daf7dbb6a10def043cdb21bb92: Status 404 returned error can't find the container with id 6d13699aee48c51525227d474aef17c0438df1daf7dbb6a10def043cdb21bb92 Jul 09 15:30:05.456944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.456911 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" event={"ID":"6bf83d60-67ec-4d9c-9981-3547a59db57f","Type":"ContainerStarted","Data":"6d13699aee48c51525227d474aef17c0438df1daf7dbb6a10def043cdb21bb92"} Jul 09 15:30:05.524904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.524861 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.525086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:05.524916 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:05.525086 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.524993 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:05.525086 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.525013 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.525086 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.525057 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:06.525042656 +0000 UTC m=+229.240320150 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:05.525086 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:05.525075 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:06.525065528 +0000 UTC m=+229.240343023 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : configmap "kube-rbac-proxy" not found Jul 09 15:30:06.533192 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:06.533155 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:06.533604 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:06.533209 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:06.533604 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:06.533273 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:06.533604 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:06.533314 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:06.533604 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:06.533343 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.533326834 +0000 UTC m=+231.248604328 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : configmap "kube-rbac-proxy" not found Jul 09 15:30:06.533604 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:06.533362 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:08.533350849 +0000 UTC m=+231.248628344 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:07.364918 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.364885 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9h98t_ffe1d3d8-2b8a-42e5-bb66-dd873a15c694/dns-node-resolver/0.log" Jul 09 15:30:07.465885 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.465783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" event={"ID":"6bf83d60-67ec-4d9c-9981-3547a59db57f","Type":"ContainerStarted","Data":"3633261c0f6dd58d9dc4ded7326d5d87a35bf242fe9cdb153938bb9d0eaeac2e"} Jul 09 15:30:07.465885 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.465852 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" event={"ID":"6bf83d60-67ec-4d9c-9981-3547a59db57f","Type":"ContainerStarted","Data":"8cdd9a4eb2ec1cd2edc5270062e6c149d7570358177e2be2b1574abfc1c436c2"} Jul 09 15:30:07.485810 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.485756 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-bmxqx" podStartSLOduration=1.476915352 podStartE2EDuration="3.485739362s" totalImagesPullingTime="2.00882401s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:07.484222539 +0000 UTC m=+230.199500056" watchObservedRunningTime="2026-07-09 15:30:07.485739362 +0000 UTC m=+230.201016879" Jul 09 15:30:07.745385 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.745276 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:07.745791 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:07.745390 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:07.745791 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:07.745436 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:07.745791 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:07.745526 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.745510302 +0000 UTC m=+238.460787810 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:07.745791 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:07.745544 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:07.745791 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:07.745594 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:15.745581977 +0000 UTC m=+238.460859476 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:08.552315 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:08.552274 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:08.552548 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:08.552333 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:08.552548 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:08.552404 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:08.552548 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:08.552450 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:08.552548 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:08.552477 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.552460703 +0000 UTC m=+235.267738200 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : configmap "kube-rbac-proxy" not found Jul 09 15:30:08.552548 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:08.552521 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:12.552485256 +0000 UTC m=+235.267762750 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:08.566840 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:08.566808 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pzrzd_06421120-f8ab-418a-aaa7-7732cb928eb8/node-ca/0.log" Jul 09 15:30:09.365128 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:09.365082 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjmkc_146b723e-c41e-43d6-b087-6f8ec5802f2d/serve-healthcheck-canary/0.log" Jul 09 15:30:09.765386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:09.765352 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bmxqx_6bf83d60-67ec-4d9c-9981-3547a59db57f/migrator/0.log" Jul 09 15:30:09.964624 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:09.964600 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bmxqx_6bf83d60-67ec-4d9c-9981-3547a59db57f/graceful-termination/0.log" Jul 09 15:30:10.165963 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:10.165930 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jcht6_2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1/kube-storage-version-migrator-operator/0.log" Jul 09 15:30:12.585095 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:12.585054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:12.585484 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:12.585167 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:12.585484 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:12.585213 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:12.585484 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:12.585238 2581 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 09 15:30:12.585484 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:12.585281 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:20.58526816 +0000 UTC m=+243.300545655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : configmap "kube-rbac-proxy" not found Jul 09 15:30:12.585484 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:12.585294 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:20.585287951 +0000 UTC m=+243.300565446 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:15.809551 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:15.809517 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:15.809967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:15.809586 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:15.809967 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:15.809675 2581 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 09 15:30:15.809967 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:15.809716 2581 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:15.809967 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:15.809739 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert podName:9fbd13fb-b417-4bd6-b85d-4b77de35e68c nodeName:}" failed. No retries permitted until 2026-07-09 15:30:31.809718471 +0000 UTC m=+254.524995967 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-jzvsg" (UID: "9fbd13fb-b417-4bd6-b85d-4b77de35e68c") : secret "networking-console-plugin-cert" not found Jul 09 15:30:15.809967 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:15.809763 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls podName:0850d09b-0ec7-4f07-9a79-44a7c9fd91bf nodeName:}" failed. No retries permitted until 2026-07-09 15:30:31.809750402 +0000 UTC m=+254.525027897 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-49k82" (UID: "0850d09b-0ec7-4f07-9a79-44a7c9fd91bf") : secret "cluster-monitoring-operator-tls" not found Jul 09 15:30:20.650108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:20.650067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:20.650834 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:20.650201 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:20.650834 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:20.650231 2581 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 09 15:30:20.650834 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:20.650327 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls podName:b6c68179-703e-46d8-ac47-95d6f55381bd nodeName:}" failed. No retries permitted until 2026-07-09 15:30:36.65030137 +0000 UTC m=+259.365578868 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls") pod "insights-runtime-extractor-28hwq" (UID: "b6c68179-703e-46d8-ac47-95d6f55381bd") : secret "insights-runtime-extractor-tls" not found Jul 09 15:30:20.651008 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:20.650883 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/b6c68179-703e-46d8-ac47-95d6f55381bd-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:29.722751 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:29.722713 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:30:29.725127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:29.725106 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0a43e8b8-053d-462f-b5fd-d1884a6cce39-metrics-certs\") pod \"network-metrics-daemon-985tq\" (UID: \"0a43e8b8-053d-462f-b5fd-d1884a6cce39\") " pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:30:29.813453 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:29.813415 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ht5qx\"" Jul 09 15:30:29.818475 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:29.818450 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-985tq" Jul 09 15:30:29.958646 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:29.958614 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-985tq"] Jul 09 15:30:29.961939 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:29.961878 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a43e8b8_053d_462f_b5fd_d1884a6cce39.slice/crio-02bc544cb30b9a1ca12eac580eeae5c1faa9c6f2bdd716aa5ae3b0825c64d5e7 WatchSource:0}: Error finding container 02bc544cb30b9a1ca12eac580eeae5c1faa9c6f2bdd716aa5ae3b0825c64d5e7: Status 404 returned error can't find the container with id 02bc544cb30b9a1ca12eac580eeae5c1faa9c6f2bdd716aa5ae3b0825c64d5e7 Jul 09 15:30:30.536992 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:30.536953 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-985tq" event={"ID":"0a43e8b8-053d-462f-b5fd-d1884a6cce39","Type":"ContainerStarted","Data":"02bc544cb30b9a1ca12eac580eeae5c1faa9c6f2bdd716aa5ae3b0825c64d5e7"} Jul 09 15:30:31.408248 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.408212 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-hxh8v"] Jul 09 15:30:31.411653 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.411626 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:31.414542 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.414512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-z69bv\"" Jul 09 15:30:31.414693 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.414512 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 15:30:31.414693 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.414669 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 15:30:31.425105 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.425075 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hxh8v"] Jul 09 15:30:31.536863 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.536830 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9bsb9\" (UniqueName: \"kubernetes.io/projected/cec78051-a31e-4985-b7ca-5c5413b3a9c0-kube-api-access-9bsb9\") pod \"downloads-68c9cbb497-hxh8v\" (UID: \"cec78051-a31e-4985-b7ca-5c5413b3a9c0\") " pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:31.637886 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.637847 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9bsb9\" (UniqueName: \"kubernetes.io/projected/cec78051-a31e-4985-b7ca-5c5413b3a9c0-kube-api-access-9bsb9\") pod \"downloads-68c9cbb497-hxh8v\" (UID: \"cec78051-a31e-4985-b7ca-5c5413b3a9c0\") " pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:31.647728 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.647694 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9bsb9\" (UniqueName: \"kubernetes.io/projected/cec78051-a31e-4985-b7ca-5c5413b3a9c0-kube-api-access-9bsb9\") pod \"downloads-68c9cbb497-hxh8v\" (UID: \"cec78051-a31e-4985-b7ca-5c5413b3a9c0\") " pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:31.721612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.721519 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:31.839707 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.839671 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:31.839870 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.839749 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:31.842420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.842391 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/9fbd13fb-b417-4bd6-b85d-4b77de35e68c-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-jzvsg\" (UID: \"9fbd13fb-b417-4bd6-b85d-4b77de35e68c\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:31.842420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.842414 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0850d09b-0ec7-4f07-9a79-44a7c9fd91bf-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-49k82\" (UID: \"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:31.856668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:31.856572 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-hxh8v"] Jul 09 15:30:31.859050 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:31.859017 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcec78051_a31e_4985_b7ca_5c5413b3a9c0.slice/crio-58d75f7b6ac73b5bd868aee729749d25e698a4aa7713cdf9aa501f368fef5fbe WatchSource:0}: Error finding container 58d75f7b6ac73b5bd868aee729749d25e698a4aa7713cdf9aa501f368fef5fbe: Status 404 returned error can't find the container with id 58d75f7b6ac73b5bd868aee729749d25e698a4aa7713cdf9aa501f368fef5fbe Jul 09 15:30:32.047124 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.047040 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-52szh\"" Jul 09 15:30:32.055113 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.055091 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" Jul 09 15:30:32.059970 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.059951 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-n9jtm\"" Jul 09 15:30:32.068206 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.068174 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" Jul 09 15:30:32.192937 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.192786 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82"] Jul 09 15:30:32.195383 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:32.195353 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0850d09b_0ec7_4f07_9a79_44a7c9fd91bf.slice/crio-20536d34507d617a2cd72f467f1d9250349f46af4937f58ab2ae2f0f55790da2 WatchSource:0}: Error finding container 20536d34507d617a2cd72f467f1d9250349f46af4937f58ab2ae2f0f55790da2: Status 404 returned error can't find the container with id 20536d34507d617a2cd72f467f1d9250349f46af4937f58ab2ae2f0f55790da2 Jul 09 15:30:32.211141 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.211116 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-jzvsg"] Jul 09 15:30:32.213407 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:32.213369 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fbd13fb_b417_4bd6_b85d_4b77de35e68c.slice/crio-bd804ddf9360b71b69a977d3028dbafa74394d4ef2a68f2b45fa13bdef492ec2 WatchSource:0}: Error finding container bd804ddf9360b71b69a977d3028dbafa74394d4ef2a68f2b45fa13bdef492ec2: Status 404 returned error can't find the container with id bd804ddf9360b71b69a977d3028dbafa74394d4ef2a68f2b45fa13bdef492ec2 Jul 09 15:30:32.545723 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.545671 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" event={"ID":"9fbd13fb-b417-4bd6-b85d-4b77de35e68c","Type":"ContainerStarted","Data":"bd804ddf9360b71b69a977d3028dbafa74394d4ef2a68f2b45fa13bdef492ec2"} Jul 09 15:30:32.547013 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.546983 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" event={"ID":"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf","Type":"ContainerStarted","Data":"20536d34507d617a2cd72f467f1d9250349f46af4937f58ab2ae2f0f55790da2"} Jul 09 15:30:32.548471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:32.548444 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hxh8v" event={"ID":"cec78051-a31e-4985-b7ca-5c5413b3a9c0","Type":"ContainerStarted","Data":"58d75f7b6ac73b5bd868aee729749d25e698a4aa7713cdf9aa501f368fef5fbe"} Jul 09 15:30:33.556625 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:33.556586 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" event={"ID":"9fbd13fb-b417-4bd6-b85d-4b77de35e68c","Type":"ContainerStarted","Data":"ab5d681cef1ace38d4cdad442d6bb4ef7a72c2f57bc8f199d972840daf2a39ab"} Jul 09 15:30:33.590376 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:33.590311 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-jzvsg" podStartSLOduration=33.416362816 podStartE2EDuration="34.590287284s" totalImagesPullingTime="1.173924468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:33.589083325 +0000 UTC m=+256.304360844" watchObservedRunningTime="2026-07-09 15:30:33.590287284 +0000 UTC m=+256.305564783" Jul 09 15:30:34.563422 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:34.563379 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-985tq" event={"ID":"0a43e8b8-053d-462f-b5fd-d1884a6cce39","Type":"ContainerStarted","Data":"d55c8a2f8aa7b78a2c27ac48f9a08d7c6b74d2b031776608227fe087dfcf7d26"} Jul 09 15:30:34.563864 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:34.563454 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-985tq" event={"ID":"0a43e8b8-053d-462f-b5fd-d1884a6cce39","Type":"ContainerStarted","Data":"73a6259d4105ea2761b049db67e14c85f66bc3c47acd1d5225033c388ca00535"} Jul 09 15:30:34.583356 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:34.583266 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-985tq" podStartSLOduration=251.820059328 podStartE2EDuration="4m15.583242739s" totalImagesPullingTime="3.763183411s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:34.582004805 +0000 UTC m=+257.297282322" watchObservedRunningTime="2026-07-09 15:30:34.583242739 +0000 UTC m=+257.298520255" Jul 09 15:30:35.570333 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.570290 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" event={"ID":"0850d09b-0ec7-4f07-9a79-44a7c9fd91bf","Type":"ContainerStarted","Data":"aaea29b44140779ffdc833916b611214c769e532ad5f8c1b65da208f685b6816"} Jul 09 15:30:35.588881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.588817 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-49k82" podStartSLOduration=33.7053498 podStartE2EDuration="36.588797532s" totalImagesPullingTime="2.883447732s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:35.587520976 +0000 UTC m=+258.302798493" watchObservedRunningTime="2026-07-09 15:30:35.588797532 +0000 UTC m=+258.304075244" Jul 09 15:30:35.599046 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.599017 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q"] Jul 09 15:30:35.602459 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.602431 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:35.605319 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.605109 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-gf577\"" Jul 09 15:30:35.605319 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.605180 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 09 15:30:35.611451 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.611416 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q"] Jul 09 15:30:35.673174 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.673132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hrz5q\" (UID: \"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:35.774403 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:35.774361 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hrz5q\" (UID: \"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:35.774607 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:35.774527 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 09 15:30:35.774607 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:35.774606 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates podName:69f18f41-7f94-47a7-a3d8-8c36b57c8f0e nodeName:}" failed. No retries permitted until 2026-07-09 15:30:36.274586551 +0000 UTC m=+258.989864051 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-hrz5q" (UID: "69f18f41-7f94-47a7-a3d8-8c36b57c8f0e") : secret "prometheus-operator-admission-webhook-tls" not found Jul 09 15:30:36.278709 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.278666 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hrz5q\" (UID: \"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:36.281725 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.281695 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/69f18f41-7f94-47a7-a3d8-8c36b57c8f0e-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-hrz5q\" (UID: \"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:36.513852 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.513801 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:36.677149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.677123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q"] Jul 09 15:30:36.680006 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:36.679976 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod69f18f41_7f94_47a7_a3d8_8c36b57c8f0e.slice/crio-699ecef0a092a8914b8440b8a0f393baaa4e93476d677191fd5157a2a9d4913b WatchSource:0}: Error finding container 699ecef0a092a8914b8440b8a0f393baaa4e93476d677191fd5157a2a9d4913b: Status 404 returned error can't find the container with id 699ecef0a092a8914b8440b8a0f393baaa4e93476d677191fd5157a2a9d4913b Jul 09 15:30:36.682162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.682140 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:36.685330 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.685298 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/b6c68179-703e-46d8-ac47-95d6f55381bd-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-28hwq\" (UID: \"b6c68179-703e-46d8-ac47-95d6f55381bd\") " pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:36.878233 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.878148 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tdrfs\"" Jul 09 15:30:36.886613 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:36.886587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-28hwq" Jul 09 15:30:37.041390 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:37.041356 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-28hwq"] Jul 09 15:30:37.044489 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:37.044457 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6c68179_703e_46d8_ac47_95d6f55381bd.slice/crio-bafb92a07f8e818f336a5d2c70d87901c8048e6dfe34f5cce9afb37e9ab0e03b WatchSource:0}: Error finding container bafb92a07f8e818f336a5d2c70d87901c8048e6dfe34f5cce9afb37e9ab0e03b: Status 404 returned error can't find the container with id bafb92a07f8e818f336a5d2c70d87901c8048e6dfe34f5cce9afb37e9ab0e03b Jul 09 15:30:37.580247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:37.580162 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-28hwq" event={"ID":"b6c68179-703e-46d8-ac47-95d6f55381bd","Type":"ContainerStarted","Data":"bafb92a07f8e818f336a5d2c70d87901c8048e6dfe34f5cce9afb37e9ab0e03b"} Jul 09 15:30:37.583275 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:37.583205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" event={"ID":"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e","Type":"ContainerStarted","Data":"699ecef0a092a8914b8440b8a0f393baaa4e93476d677191fd5157a2a9d4913b"} Jul 09 15:30:38.590046 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:38.590010 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" event={"ID":"69f18f41-7f94-47a7-a3d8-8c36b57c8f0e","Type":"ContainerStarted","Data":"672d99be693e9819aed3449bba158de764c36f121a3cba0bf23c2dab9ea61d87"} Jul 09 15:30:38.591968 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:38.591938 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:38.597165 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:38.593075 2581 patch_prober.go:28] interesting pod/prometheus-operator-admission-webhook-77d98bc786-hrz5q container/prometheus-operator-admission-webhook namespace/openshift-monitoring: Readiness probe status=failure output="Get \"https://10.132.0.18:8443/healthz\": dial tcp 10.132.0.18:8443: connect: connection refused" start-of-body= Jul 09 15:30:38.597165 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:38.593133 2581 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" podUID="69f18f41-7f94-47a7-a3d8-8c36b57c8f0e" containerName="prometheus-operator-admission-webhook" probeResult="failure" output="Get \"https://10.132.0.18:8443/healthz\": dial tcp 10.132.0.18:8443: connect: connection refused" Jul 09 15:30:39.248122 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.248058 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" podStartSLOduration=2.455151019 podStartE2EDuration="4.248037982s" totalImagesPullingTime="1.792886963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:38.611734747 +0000 UTC m=+261.327012265" watchObservedRunningTime="2026-07-09 15:30:39.248037982 +0000 UTC m=+261.963315500" Jul 09 15:30:39.249405 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.249378 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:30:39.260222 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.260186 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.266274 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.266238 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 15:30:39.266429 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.266238 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 15:30:39.266429 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.266364 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 15:30:39.266597 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.266576 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 15:30:39.266984 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.266948 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:30:39.267576 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.267162 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z6sb7\"" Jul 09 15:30:39.267576 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.267391 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 15:30:39.409867 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.409828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkbvj\" (UniqueName: \"kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.410071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.409903 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.410071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.409969 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.410071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.409992 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.410239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.410069 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.410239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.410138 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511469 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511376 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511469 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511478 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511525 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511573 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.511676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.511626 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkbvj\" (UniqueName: \"kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.512178 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.512149 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.512751 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.512725 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.513314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.513251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.515027 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.515001 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.515131 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.515046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.520955 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.520929 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkbvj\" (UniqueName: \"kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj\") pod \"console-7c5bdbbfff-w4jnm\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.575003 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.574848 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:39.600361 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:39.600331 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-hrz5q" Jul 09 15:30:40.676913 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.676791 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jntt6"] Jul 09 15:30:40.685473 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.685444 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.689242 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.689211 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 15:30:40.690552 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.690070 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 15:30:40.690552 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.690272 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 15:30:40.690552 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.690410 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-twzr9\"" Jul 09 15:30:40.691371 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.691174 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jntt6"] Jul 09 15:30:40.822471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.822416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.822658 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.822479 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.822742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.822709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.822905 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.822868 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bznj4\" (UniqueName: \"kubernetes.io/projected/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-kube-api-access-bznj4\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.924171 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.924131 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.924369 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.924238 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bznj4\" (UniqueName: \"kubernetes.io/projected/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-kube-api-access-bznj4\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.924369 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.924275 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.924369 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.924305 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.924566 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:40.924439 2581 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jul 09 15:30:40.924566 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:40.924544 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls podName:3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de nodeName:}" failed. No retries permitted until 2026-07-09 15:30:41.42452756 +0000 UTC m=+264.139805058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls") pod "prometheus-operator-64785b6675-jntt6" (UID: "3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de") : secret "prometheus-operator-tls" not found Jul 09 15:30:40.925473 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.925422 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-metrics-client-ca\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.928887 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.928823 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:40.934697 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:40.934641 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bznj4\" (UniqueName: \"kubernetes.io/projected/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-kube-api-access-bznj4\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:41.430368 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:41.430311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:41.433555 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:41.433525 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-jntt6\" (UID: \"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de\") " pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:41.599475 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:41.599249 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" Jul 09 15:30:41.805152 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:41.805119 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:30:41.805582 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:41.805338 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode07c3b4c_e879_42f3_a205_a838aac8b4ee.slice/crio-343b92d3e42d3ab0f137d78e678afd2e7359481de0b5e1b969f3da7902d52c20 WatchSource:0}: Error finding container 343b92d3e42d3ab0f137d78e678afd2e7359481de0b5e1b969f3da7902d52c20: Status 404 returned error can't find the container with id 343b92d3e42d3ab0f137d78e678afd2e7359481de0b5e1b969f3da7902d52c20 Jul 09 15:30:41.857016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:41.856984 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-jntt6"] Jul 09 15:30:41.859534 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:41.859488 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b92b89a_c8fe_4c5b_a0ea_8b7f3e8555de.slice/crio-03c9e0cfd329bc3f376e356cdb0084f8a643daf417aa13c8e9c69e79de01ed99 WatchSource:0}: Error finding container 03c9e0cfd329bc3f376e356cdb0084f8a643daf417aa13c8e9c69e79de01ed99: Status 404 returned error can't find the container with id 03c9e0cfd329bc3f376e356cdb0084f8a643daf417aa13c8e9c69e79de01ed99 Jul 09 15:30:42.611676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:42.611574 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" event={"ID":"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de","Type":"ContainerStarted","Data":"03c9e0cfd329bc3f376e356cdb0084f8a643daf417aa13c8e9c69e79de01ed99"} Jul 09 15:30:42.613464 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:42.613426 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5bdbbfff-w4jnm" event={"ID":"e07c3b4c-e879-42f3-a205-a838aac8b4ee","Type":"ContainerStarted","Data":"343b92d3e42d3ab0f137d78e678afd2e7359481de0b5e1b969f3da7902d52c20"} Jul 09 15:30:42.615547 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:42.615516 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-28hwq" event={"ID":"b6c68179-703e-46d8-ac47-95d6f55381bd","Type":"ContainerStarted","Data":"54f34ca87bae59a4db53f1c49f0fa59df53b710ba9660b852c4022f2efb4e7b1"} Jul 09 15:30:42.615684 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:42.615578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-28hwq" event={"ID":"b6c68179-703e-46d8-ac47-95d6f55381bd","Type":"ContainerStarted","Data":"ee1dc9cdbf8c23c3aece3de07f712cfc8cf8c80e1fd54746e7c17830d87de413"} Jul 09 15:30:52.660022 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.659964 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" event={"ID":"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de","Type":"ContainerStarted","Data":"da0ab2acfdfb62ffa8917fdc2ea34cd2b7a0b9b674b6cab156ef6e2f25a90657"} Jul 09 15:30:52.660645 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.660061 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" event={"ID":"3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de","Type":"ContainerStarted","Data":"2bdb8da2a81b23a4978448b048454dddb52ee208644ed5998f41addd8ddfdf45"} Jul 09 15:30:52.662915 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.662472 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-hxh8v" event={"ID":"cec78051-a31e-4985-b7ca-5c5413b3a9c0","Type":"ContainerStarted","Data":"9d5a3097153e95feb5f7e97ee3e9445735b1d67fccece53582c2fc7279a14b6d"} Jul 09 15:30:52.662915 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.662689 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:52.665729 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.665698 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5bdbbfff-w4jnm" event={"ID":"e07c3b4c-e879-42f3-a205-a838aac8b4ee","Type":"ContainerStarted","Data":"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363"} Jul 09 15:30:52.674882 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.674848 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-hxh8v" Jul 09 15:30:52.680658 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.680039 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-jntt6" podStartSLOduration=2.923455342 podStartE2EDuration="12.680021044s" totalImagesPullingTime="9.756565702s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:52.679780117 +0000 UTC m=+275.395057636" watchObservedRunningTime="2026-07-09 15:30:52.680021044 +0000 UTC m=+275.395298560" Jul 09 15:30:52.700275 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:52.700183 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-hxh8v" podStartSLOduration=1.886017366 podStartE2EDuration="21.700159566s" totalImagesPullingTime="19.8141422s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:52.698805288 +0000 UTC m=+275.414082798" watchObservedRunningTime="2026-07-09 15:30:52.700159566 +0000 UTC m=+275.415437084" Jul 09 15:30:55.093238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.093117 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c5bdbbfff-w4jnm" podStartSLOduration=6.270700205 podStartE2EDuration="16.0930939s" totalImagesPullingTime="9.822393695s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:52.723545161 +0000 UTC m=+275.438822678" watchObservedRunningTime="2026-07-09 15:30:55.0930939 +0000 UTC m=+277.808371418" Jul 09 15:30:55.093831 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.093803 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-577cb"] Jul 09 15:30:55.116892 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.116855 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.121482 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.121451 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-8r4sg\"" Jul 09 15:30:55.121658 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.121512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 15:30:55.122407 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.122384 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 15:30:55.126217 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.126193 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 15:30:55.262888 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.262852 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-metrics-client-ca\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.262906 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-wtmp\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.262940 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sb6x\" (UniqueName: \"kubernetes.io/projected/54e8cc13-fcd1-4040-92fa-71638d23e85f-kube-api-access-8sb6x\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263071 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.262979 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-sys\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.263072 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-tls\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.263132 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.263167 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-root\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.263229 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-textfile\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.263436 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.263272 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364373 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364281 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-textfile\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364373 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364384 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-metrics-client-ca\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364435 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-wtmp\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364465 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sb6x\" (UniqueName: \"kubernetes.io/projected/54e8cc13-fcd1-4040-92fa-71638d23e85f-kube-api-access-8sb6x\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364518 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-sys\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364560 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-tls\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364612 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364607 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364930 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364634 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-root\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364930 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364719 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-textfile\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364930 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364724 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-root\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.364930 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364799 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-sys\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.365238 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.364872 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-wtmp\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.365453 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.365428 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-metrics-client-ca\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.366013 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.365992 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-accelerators-collector-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.367372 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.367347 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.367526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.367481 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/54e8cc13-fcd1-4040-92fa-71638d23e85f-node-exporter-tls\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.374089 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.374060 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sb6x\" (UniqueName: \"kubernetes.io/projected/54e8cc13-fcd1-4040-92fa-71638d23e85f-kube-api-access-8sb6x\") pod \"node-exporter-577cb\" (UID: \"54e8cc13-fcd1-4040-92fa-71638d23e85f\") " pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.428031 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.427992 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-577cb" Jul 09 15:30:55.469205 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:55.469169 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54e8cc13_fcd1_4040_92fa_71638d23e85f.slice/crio-95e08a03935125ff53f2ebce18e60961c2b77d9cb75919aff4c2be338691bcbe WatchSource:0}: Error finding container 95e08a03935125ff53f2ebce18e60961c2b77d9cb75919aff4c2be338691bcbe: Status 404 returned error can't find the container with id 95e08a03935125ff53f2ebce18e60961c2b77d9cb75919aff4c2be338691bcbe Jul 09 15:30:55.680057 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.680003 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-577cb" event={"ID":"54e8cc13-fcd1-4040-92fa-71638d23e85f","Type":"ContainerStarted","Data":"95e08a03935125ff53f2ebce18e60961c2b77d9cb75919aff4c2be338691bcbe"} Jul 09 15:30:55.683249 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.683205 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-28hwq" event={"ID":"b6c68179-703e-46d8-ac47-95d6f55381bd","Type":"ContainerStarted","Data":"43848e1fa68b307ab1cc26c4fe5f9090acb0fc633cbbb5f9c8be903e1056d3da"} Jul 09 15:30:55.704943 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:55.704876 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-28hwq" podStartSLOduration=34.240576823 podStartE2EDuration="51.704854302s" totalImagesPullingTime="17.464277479s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:04 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:55.704395578 +0000 UTC m=+278.419673112" watchObservedRunningTime="2026-07-09 15:30:55.704854302 +0000 UTC m=+278.420131820" Jul 09 15:30:56.115516 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.115392 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:56.165959 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.165923 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:56.166222 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.166104 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.169451 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.169423 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 15:30:56.169746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.169726 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 15:30:56.169923 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.169904 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 15:30:56.170103 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170087 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 15:30:56.170215 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170198 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 15:30:56.170562 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170543 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zrtnq\"" Jul 09 15:30:56.170835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170817 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 15:30:56.170969 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170887 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 15:30:56.170969 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170897 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 15:30:56.171100 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.170828 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 15:30:56.273424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273376 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273439 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273518 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273564 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273599 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273626 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273647 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273742 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273796 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273828 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273856 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9crc\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.273881 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273880 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.274150 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.273914 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375464 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375346 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375464 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375404 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375464 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375441 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375466 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375523 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375554 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375575 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375627 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375676 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375731 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9crc\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.375815 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:56.375747 2581 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 09 15:30:56.376236 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:56.375828 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls podName:0f59314f-683e-45d7-91f9-5d94e0c58b65 nodeName:}" failed. No retries permitted until 2026-07-09 15:30:56.875806574 +0000 UTC m=+279.591084092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65") : secret "alertmanager-main-tls" not found Jul 09 15:30:56.377405 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.377318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.377560 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.377418 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.378638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.378008 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.378638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.375756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.378638 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.378355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.385381 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.385318 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.386759 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.386472 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.387569 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.387486 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.388094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.388058 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.388094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.388086 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.390375 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.390348 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.390659 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.390600 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9crc\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.393214 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.393189 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.395136 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.395111 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.882307 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.882252 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:56.887078 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:56.887046 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:57.080922 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:57.080879 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:30:57.287437 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:57.287400 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:30:57.292807 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:57.292772 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f59314f_683e_45d7_91f9_5d94e0c58b65.slice/crio-e9569ac15c4e26ffa9431f3c86e0ff300fd45dbe06ccdbdc4ed9d2f5d9b9131d WatchSource:0}: Error finding container e9569ac15c4e26ffa9431f3c86e0ff300fd45dbe06ccdbdc4ed9d2f5d9b9131d: Status 404 returned error can't find the container with id e9569ac15c4e26ffa9431f3c86e0ff300fd45dbe06ccdbdc4ed9d2f5d9b9131d Jul 09 15:30:57.698562 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:57.698523 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"e9569ac15c4e26ffa9431f3c86e0ff300fd45dbe06ccdbdc4ed9d2f5d9b9131d"} Jul 09 15:30:57.700532 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:57.700471 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-577cb" event={"ID":"54e8cc13-fcd1-4040-92fa-71638d23e85f","Type":"ContainerStarted","Data":"86ec5c5327722a3a126e679d8e1a37f342adc93589589390149dde4b2360c4fd"} Jul 09 15:30:58.109984 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.109940 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-546d7d69f6-npqx9"] Jul 09 15:30:58.134413 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.134283 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546d7d69f6-npqx9"] Jul 09 15:30:58.134413 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.134411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.137543 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137512 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-cr4666fv0jenq\"" Jul 09 15:30:58.137706 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137585 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 09 15:30:58.137706 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137648 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 09 15:30:58.137706 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137691 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-j9fdw\"" Jul 09 15:30:58.137876 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137514 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 09 15:30:58.137876 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.137819 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 09 15:30:58.138364 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.138337 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 09 15:30:58.199366 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199327 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199387 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199416 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdf8304-b510-447e-8cd5-294332fa63fa-metrics-client-ca\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199455 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199573 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199803 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199611 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4kwzm\" (UniqueName: \"kubernetes.io/projected/dbdf8304-b510-447e-8cd5-294332fa63fa-kube-api-access-4kwzm\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199803 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.199803 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.199673 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-grpc-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.300972 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.300925 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.300972 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.300979 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-grpc-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301067 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301093 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdf8304-b510-447e-8cd5-294332fa63fa-metrics-client-ca\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301129 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301223 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.301571 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.301263 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4kwzm\" (UniqueName: \"kubernetes.io/projected/dbdf8304-b510-447e-8cd5-294332fa63fa-kube-api-access-4kwzm\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.303244 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.303157 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/dbdf8304-b510-447e-8cd5-294332fa63fa-metrics-client-ca\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.305762 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.305734 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-grpc-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.308106 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.306681 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.308106 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.307107 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-tls\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.308106 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.307585 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.308106 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.308051 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.308599 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.308576 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/dbdf8304-b510-447e-8cd5-294332fa63fa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.311866 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.311838 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4kwzm\" (UniqueName: \"kubernetes.io/projected/dbdf8304-b510-447e-8cd5-294332fa63fa-kube-api-access-4kwzm\") pod \"thanos-querier-546d7d69f6-npqx9\" (UID: \"dbdf8304-b510-447e-8cd5-294332fa63fa\") " pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.450702 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.450417 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:30:58.670030 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.670005 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-546d7d69f6-npqx9"] Jul 09 15:30:58.707234 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.707151 2581 generic.go:356] "Generic (PLEG): container finished" podID="54e8cc13-fcd1-4040-92fa-71638d23e85f" containerID="86ec5c5327722a3a126e679d8e1a37f342adc93589589390149dde4b2360c4fd" exitCode=0 Jul 09 15:30:58.707417 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:58.707245 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-577cb" event={"ID":"54e8cc13-fcd1-4040-92fa-71638d23e85f","Type":"ContainerDied","Data":"86ec5c5327722a3a126e679d8e1a37f342adc93589589390149dde4b2360c4fd"} Jul 09 15:30:58.815087 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:30:58.815053 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbdf8304_b510_447e_8cd5_294332fa63fa.slice/crio-8bcc7a7e495c4c60f2be18b736a50413753427b80a00bc85f23d223e6d142fbc WatchSource:0}: Error finding container 8bcc7a7e495c4c60f2be18b736a50413753427b80a00bc85f23d223e6d142fbc: Status 404 returned error can't find the container with id 8bcc7a7e495c4c60f2be18b736a50413753427b80a00bc85f23d223e6d142fbc Jul 09 15:30:59.273458 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:59.273364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" Jul 09 15:30:59.273458 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:30:59.273364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-7drzr" podUID="5c521020-43d2-4ab5-9ecd-52f3df5ee0c4" Jul 09 15:30:59.575704 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.575600 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:59.576364 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.576339 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:30:59.578471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.577469 2581 patch_prober.go:28] interesting pod/console-7c5bdbbfff-w4jnm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" start-of-body= Jul 09 15:30:59.578471 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.577546 2581 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7c5bdbbfff-w4jnm" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerName="console" probeResult="failure" output="Get \"https://10.132.0.19:8443/health\": dial tcp 10.132.0.19:8443: connect: connection refused" Jul 09 15:30:59.714448 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.714393 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5" exitCode=0 Jul 09 15:30:59.714990 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.714762 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5"} Jul 09 15:30:59.719383 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.719280 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-577cb" event={"ID":"54e8cc13-fcd1-4040-92fa-71638d23e85f","Type":"ContainerStarted","Data":"1779926e94567defaa7ad362b6fc5f9783fcd487bd63c8361ea2832807da7f6a"} Jul 09 15:30:59.719383 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.719358 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-577cb" event={"ID":"54e8cc13-fcd1-4040-92fa-71638d23e85f","Type":"ContainerStarted","Data":"78661cbc5e323c5ad2fded3069137089bc0b33fbb933802b304acfdf696500f6"} Jul 09 15:30:59.721731 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.721705 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"8bcc7a7e495c4c60f2be18b736a50413753427b80a00bc85f23d223e6d142fbc"} Jul 09 15:30:59.721898 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.721770 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:30:59.721898 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.721875 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7drzr" Jul 09 15:30:59.768258 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.768190 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-577cb" podStartSLOduration=2.674817881 podStartE2EDuration="4.76814232s" totalImagesPullingTime="2.014550812s" totalInitContainerRuntime="78.773627ms" isStatefulPod=true podCreationTimestamp="2026-07-09 15:30:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:30:59.767566865 +0000 UTC m=+282.482844384" watchObservedRunningTime="2026-07-09 15:30:59.76814232 +0000 UTC m=+282.483419836" Jul 09 15:30:59.838315 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.838232 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:30:59.841528 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.841479 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s"] Jul 09 15:30:59.876643 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.876548 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s"] Jul 09 15:30:59.877427 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.876914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:30:59.881006 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.880980 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 15:30:59.882184 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.882147 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-ctg25\"" Jul 09 15:30:59.920749 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.920713 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:30:59.920940 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:30:59.920807 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tkfxk\" (UniqueName: \"kubernetes.io/projected/02645cee-27a3-4861-8bf8-17be8501c3df-kube-api-access-tkfxk\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.022166 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.021919 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.022166 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.021994 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tkfxk\" (UniqueName: \"kubernetes.io/projected/02645cee-27a3-4861-8bf8-17be8501c3df-kube-api-access-tkfxk\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.022442 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:31:00.022340 2581 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 09 15:31:00.022442 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:31:00.022407 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert podName:02645cee-27a3-4861-8bf8-17be8501c3df nodeName:}" failed. No retries permitted until 2026-07-09 15:31:00.522386959 +0000 UTC m=+283.237664471 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-d4g6s" (UID: "02645cee-27a3-4861-8bf8-17be8501c3df") : secret "monitoring-plugin-cert" not found Jul 09 15:31:00.039002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.038968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tkfxk\" (UniqueName: \"kubernetes.io/projected/02645cee-27a3-4861-8bf8-17be8501c3df-kube-api-access-tkfxk\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.527545 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.527487 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.530606 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.530570 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/02645cee-27a3-4861-8bf8-17be8501c3df-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-d4g6s\" (UID: \"02645cee-27a3-4861-8bf8-17be8501c3df\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:00.791519 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:00.791393 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:02.587777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.587742 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s"] Jul 09 15:31:02.739398 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.739370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"47273d186720c9aa492f7ed203b2f8327086ab8afb7a50c0adbf47e8b9ff602c"} Jul 09 15:31:02.739544 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.739441 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"77e803ac6022d73ce49c8b254f50b65350c48bdc083f4ee7d9faf2bd63c83f33"} Jul 09 15:31:02.741618 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.741595 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b"} Jul 09 15:31:02.741722 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.741661 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b"} Jul 09 15:31:02.742785 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:02.742761 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" event={"ID":"02645cee-27a3-4861-8bf8-17be8501c3df","Type":"ContainerStarted","Data":"e3cafc71b77c77478d97210c6ddb4b69443c6810cd519d33df46673801d9e61e"} Jul 09 15:31:03.151960 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.151920 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:03.152149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.152008 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:31:03.154405 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.154376 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c521020-43d2-4ab5-9ecd-52f3df5ee0c4-metrics-tls\") pod \"dns-default-7drzr\" (UID: \"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4\") " pod="openshift-dns/dns-default-7drzr" Jul 09 15:31:03.154553 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.154534 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"image-registry-77c5b95f4d-6pj47\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:03.326257 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.326176 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-jqnp4\"" Jul 09 15:31:03.326257 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.326176 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-gwbcf\"" Jul 09 15:31:03.333616 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.333583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-7drzr" Jul 09 15:31:03.333733 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.333662 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:03.511550 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.511526 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-7drzr"] Jul 09 15:31:03.514576 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:31:03.514534 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c521020_43d2_4ab5_9ecd_52f3df5ee0c4.slice/crio-7c3487d0ab24dc51573eb8dbf11b1c07f19221f90bf20d93e4e0ebd5713cc9f9 WatchSource:0}: Error finding container 7c3487d0ab24dc51573eb8dbf11b1c07f19221f90bf20d93e4e0ebd5713cc9f9: Status 404 returned error can't find the container with id 7c3487d0ab24dc51573eb8dbf11b1c07f19221f90bf20d93e4e0ebd5713cc9f9 Jul 09 15:31:03.541520 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.541472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:31:03.543796 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:31:03.543767 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2430e841_b3af_48dc_bc0f_1064d583ab8a.slice/crio-be04df8e6dfe2739a002617c9aa8a9143fa46c8819aa33e13d8cfc531f898519 WatchSource:0}: Error finding container be04df8e6dfe2739a002617c9aa8a9143fa46c8819aa33e13d8cfc531f898519: Status 404 returned error can't find the container with id be04df8e6dfe2739a002617c9aa8a9143fa46c8819aa33e13d8cfc531f898519 Jul 09 15:31:03.752053 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.752005 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7drzr" event={"ID":"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4","Type":"ContainerStarted","Data":"7c3487d0ab24dc51573eb8dbf11b1c07f19221f90bf20d93e4e0ebd5713cc9f9"} Jul 09 15:31:03.754862 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.754827 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f"} Jul 09 15:31:03.755001 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.754902 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185"} Jul 09 15:31:03.755001 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.754942 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1"} Jul 09 15:31:03.756218 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.756189 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" event={"ID":"2430e841-b3af-48dc-bc0f-1064d583ab8a","Type":"ContainerStarted","Data":"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912"} Jul 09 15:31:03.756337 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.756235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" event={"ID":"2430e841-b3af-48dc-bc0f-1064d583ab8a","Type":"ContainerStarted","Data":"be04df8e6dfe2739a002617c9aa8a9143fa46c8819aa33e13d8cfc531f898519"} Jul 09 15:31:03.756337 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.756298 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:03.758465 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.758438 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"57e62dd60c7377e4ec352b1483e19250d89d4087ac9f3e4dc5ef0909942b661a"} Jul 09 15:31:03.780194 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:03.780139 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" podStartSLOduration=284.780117534 podStartE2EDuration="4m44.780117534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:03.779369786 +0000 UTC m=+286.494647304" watchObservedRunningTime="2026-07-09 15:31:03.780117534 +0000 UTC m=+286.495395053" Jul 09 15:31:04.767346 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:04.767188 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"59990afb6037952da291632fa7a6831d58fb197e85946060ebc12051c69521d5"} Jul 09 15:31:04.767346 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:04.767289 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"4b230765ebae2a4f6913f9e4393ffad3405da9ed1ba14c5f8d68d6c2950a2657"} Jul 09 15:31:04.772120 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:04.772089 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerStarted","Data":"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601"} Jul 09 15:31:04.817765 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:04.817183 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.1375767 podStartE2EDuration="8.817160405s" totalImagesPullingTime="5.656083596s" totalInitContainerRuntime="23.500109ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:04.815072677 +0000 UTC m=+287.530350195" watchObservedRunningTime="2026-07-09 15:31:04.817160405 +0000 UTC m=+287.532437926" Jul 09 15:31:05.779524 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:05.779475 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" event={"ID":"dbdf8304-b510-447e-8cd5-294332fa63fa","Type":"ContainerStarted","Data":"0910771567c9a591081c365580e50ad021060ecfd7c542e35a71a12f4986e1f7"} Jul 09 15:31:05.780028 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:05.779652 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:31:05.805906 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:05.805835 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" podStartSLOduration=2.588561029 podStartE2EDuration="7.805817316s" totalImagesPullingTime="5.217256287s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:58 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:05.805250041 +0000 UTC m=+288.520527560" watchObservedRunningTime="2026-07-09 15:31:05.805817316 +0000 UTC m=+288.521094837" Jul 09 15:31:07.789021 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.788981 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" event={"ID":"02645cee-27a3-4861-8bf8-17be8501c3df","Type":"ContainerStarted","Data":"394f573776615d6ea5afbbd7af3d71051b8d88336bd02febe235abc83129a446"} Jul 09 15:31:07.789574 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.789080 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:07.790944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.790910 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7drzr" event={"ID":"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4","Type":"ContainerStarted","Data":"2848d6f98ed2a76e90a2a9954ecced951696ef195e827f7d924ff3f7478c5404"} Jul 09 15:31:07.791094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.790965 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-7drzr" event={"ID":"5c521020-43d2-4ab5-9ecd-52f3df5ee0c4","Type":"ContainerStarted","Data":"bdd6d515724381122e241394be93db1ccb186f81dcc5cc9e722427409a08c81e"} Jul 09 15:31:07.791094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.791043 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-7drzr" Jul 09 15:31:07.794727 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.794706 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" Jul 09 15:31:07.807674 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.807619 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-d4g6s" podStartSLOduration=4.460315348 podStartE2EDuration="8.807601069s" totalImagesPullingTime="4.347285721s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:30:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:07.8071391 +0000 UTC m=+290.522416619" watchObservedRunningTime="2026-07-09 15:31:07.807601069 +0000 UTC m=+290.522878594" Jul 09 15:31:07.826044 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:07.825987 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-7drzr" podStartSLOduration=251.403611467 podStartE2EDuration="4m14.825966371s" totalImagesPullingTime="3.422354904s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:26:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:31:07.825121907 +0000 UTC m=+290.540399423" watchObservedRunningTime="2026-07-09 15:31:07.825966371 +0000 UTC m=+290.541243891" Jul 09 15:31:11.789618 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:11.789589 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-546d7d69f6-npqx9" Jul 09 15:31:17.703488 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:17.703460 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:31:17.703973 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:17.703717 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:31:17.706407 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:17.706389 2581 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 15:31:17.797630 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:17.797602 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-7drzr" Jul 09 15:31:23.337642 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:23.337607 2581 patch_prober.go:28] interesting pod/image-registry-77c5b95f4d-6pj47 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 09 15:31:23.343900 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:23.337658 2581 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 15:31:24.776419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:24.776389 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:25.759473 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:25.759400 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7c5bdbbfff-w4jnm" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerName="console" containerID="cri-o://60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363" gracePeriod=15 Jul 09 15:31:26.040145 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.040112 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:31:26.156870 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.156827 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157065 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.156888 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157065 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.156922 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157065 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.156958 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157065 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.157042 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vkbvj\" (UniqueName: \"kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157259 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.157071 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert\") pod \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\" (UID: \"e07c3b4c-e879-42f3-a205-a838aac8b4ee\") " Jul 09 15:31:26.157361 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.157334 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca" (OuterVolumeSpecName: "service-ca") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:26.157423 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.157361 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config" (OuterVolumeSpecName: "console-config") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:26.157423 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.157396 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:26.159424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.159393 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:26.159424 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.159406 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj" (OuterVolumeSpecName: "kube-api-access-vkbvj") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "kube-api-access-vkbvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:26.159575 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.159431 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e07c3b4c-e879-42f3-a205-a838aac8b4ee" (UID: "e07c3b4c-e879-42f3-a205-a838aac8b4ee"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:26.257944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.257901 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vkbvj\" (UniqueName: \"kubernetes.io/projected/e07c3b4c-e879-42f3-a205-a838aac8b4ee-kube-api-access-vkbvj\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.257944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.257936 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.258149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.257976 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-oauth-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.258149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.257991 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-console-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.258149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.258003 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-service-ca\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.258149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.258013 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e07c3b4c-e879-42f3-a205-a838aac8b4ee-oauth-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:26.872179 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.872142 2581 generic.go:356] "Generic (PLEG): container finished" podID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerID="60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363" exitCode=0 Jul 09 15:31:26.872375 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.872186 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5bdbbfff-w4jnm" event={"ID":"e07c3b4c-e879-42f3-a205-a838aac8b4ee","Type":"ContainerDied","Data":"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363"} Jul 09 15:31:26.872375 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.872205 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c5bdbbfff-w4jnm" Jul 09 15:31:26.872375 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.872235 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c5bdbbfff-w4jnm" event={"ID":"e07c3b4c-e879-42f3-a205-a838aac8b4ee","Type":"ContainerDied","Data":"343b92d3e42d3ab0f137d78e678afd2e7359481de0b5e1b969f3da7902d52c20"} Jul 09 15:31:26.872375 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.872262 2581 scope.go:117] "RemoveContainer" containerID="60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363" Jul 09 15:31:26.881713 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.881695 2581 scope.go:117] "RemoveContainer" containerID="60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363" Jul 09 15:31:26.882010 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:31:26.881989 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363\": container with ID starting with 60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363 not found: ID does not exist" containerID="60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363" Jul 09 15:31:26.882077 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.882023 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363"} err="failed to get container status \"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363\": rpc error: code = NotFound desc = could not find container \"60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363\": container with ID starting with 60a31ffa70d9dd31a7048f65375b41c11c6ac0f7c71f93bc7b262512065b4363 not found: ID does not exist" Jul 09 15:31:26.894203 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.894172 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:31:26.898372 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:26.898343 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c5bdbbfff-w4jnm"] Jul 09 15:31:27.486707 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:27.486681 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/init-config-reloader/0.log" Jul 09 15:31:27.686161 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:27.686132 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/alertmanager/0.log" Jul 09 15:31:27.812791 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:27.812715 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" path="/var/lib/kubelet/pods/e07c3b4c-e879-42f3-a205-a838aac8b4ee/volumes" Jul 09 15:31:27.885572 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:27.885543 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/config-reloader/0.log" Jul 09 15:31:28.085654 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:28.085545 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/kube-rbac-proxy-web/0.log" Jul 09 15:31:28.286032 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:28.286009 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/kube-rbac-proxy/0.log" Jul 09 15:31:28.486004 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:28.485976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/kube-rbac-proxy-metric/0.log" Jul 09 15:31:28.686009 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:28.685983 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_0f59314f-683e-45d7-91f9-5d94e0c58b65/prom-label-proxy/0.log" Jul 09 15:31:28.887226 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:28.887201 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-49k82_0850d09b-0ec7-4f07-9a79-44a7c9fd91bf/cluster-monitoring-operator/0.log" Jul 09 15:31:29.898983 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:29.898935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-d4g6s_02645cee-27a3-4861-8bf8-17be8501c3df/monitoring-plugin/0.log" Jul 09 15:31:30.086664 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:30.086636 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/init-textfile/0.log" Jul 09 15:31:30.286883 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:30.286818 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/node-exporter/0.log" Jul 09 15:31:30.486324 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:30.486296 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/kube-rbac-proxy/0.log" Jul 09 15:31:31.890206 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:31.890158 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:31:33.887115 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:33.887084 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jntt6_3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de/prometheus-operator/0.log" Jul 09 15:31:33.904699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:33.904663 2581 generic.go:356] "Generic (PLEG): container finished" podID="ef9cfd4c-d86f-419f-851b-13db72def53d" containerID="e60b48150afcc9d4a1a91508a714d447c3a047d9015942a23953149e9f5f6beb" exitCode=0 Jul 09 15:31:33.904872 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:33.904737 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" event={"ID":"ef9cfd4c-d86f-419f-851b-13db72def53d","Type":"ContainerDied","Data":"e60b48150afcc9d4a1a91508a714d447c3a047d9015942a23953149e9f5f6beb"} Jul 09 15:31:33.905098 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:33.905082 2581 scope.go:117] "RemoveContainer" containerID="e60b48150afcc9d4a1a91508a714d447c3a047d9015942a23953149e9f5f6beb" Jul 09 15:31:34.086712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.086677 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jntt6_3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de/kube-rbac-proxy/0.log" Jul 09 15:31:34.289239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.289167 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-hrz5q_69f18f41-7f94-47a7-a3d8-8c36b57c8f0e/prometheus-operator-admission-webhook/0.log" Jul 09 15:31:34.485589 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.485562 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/thanos-query/0.log" Jul 09 15:31:34.685457 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.685429 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-web/0.log" Jul 09 15:31:34.889027 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.888997 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy/0.log" Jul 09 15:31:34.917452 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.917405 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-2qkg7" event={"ID":"ef9cfd4c-d86f-419f-851b-13db72def53d","Type":"ContainerStarted","Data":"ff389917278bccfa064dbd36d7a2fa0096ce2d7a4fe8402cf00a63cd90265545"} Jul 09 15:31:34.919060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.919029 2581 generic.go:356] "Generic (PLEG): container finished" podID="2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1" containerID="992b5e740a0ab3e529b8466cb86045351a8f1500a66bf1bd1aa31a1e9ba58f55" exitCode=0 Jul 09 15:31:34.919218 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.919058 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" event={"ID":"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1","Type":"ContainerDied","Data":"992b5e740a0ab3e529b8466cb86045351a8f1500a66bf1bd1aa31a1e9ba58f55"} Jul 09 15:31:34.919416 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:34.919401 2581 scope.go:117] "RemoveContainer" containerID="992b5e740a0ab3e529b8466cb86045351a8f1500a66bf1bd1aa31a1e9ba58f55" Jul 09 15:31:35.091635 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:35.091595 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/prom-label-proxy/0.log" Jul 09 15:31:35.285458 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:35.285382 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-rules/0.log" Jul 09 15:31:35.489606 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:35.489580 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-metrics/0.log" Jul 09 15:31:35.690479 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:35.690450 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jzvsg_9fbd13fb-b417-4bd6-b85d-4b77de35e68c/networking-console-plugin/0.log" Jul 09 15:31:35.924872 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:35.924838 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-jcht6" event={"ID":"2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1","Type":"ContainerStarted","Data":"2b773aaabb9fe6080a5339bf5f2272c74b4fcc9fb45034193283cd8fab200360"} Jul 09 15:31:36.887555 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:36.887523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-hxh8v_cec78051-a31e-4985-b7ca-5c5413b3a9c0/download-server/0.log" Jul 09 15:31:37.085639 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:37.085604 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7drzr_5c521020-43d2-4ab5-9ecd-52f3df5ee0c4/dns/0.log" Jul 09 15:31:37.286712 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:37.286633 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7drzr_5c521020-43d2-4ab5-9ecd-52f3df5ee0c4/kube-rbac-proxy/0.log" Jul 09 15:31:38.289965 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:38.289934 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9h98t_ffe1d3d8-2b8a-42e5-bb66-dd873a15c694/dns-node-resolver/0.log" Jul 09 15:31:39.289117 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:39.289087 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjmkc_146b723e-c41e-43d6-b087-6f8ec5802f2d/serve-healthcheck-canary/0.log" Jul 09 15:31:56.911433 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:56.911371 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerName="registry" containerID="cri-o://960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912" gracePeriod=30 Jul 09 15:31:58.660018 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.659991 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:58.740889 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.740853 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.740904 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.740929 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.740980 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.741009 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741245 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.741062 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741245 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.741098 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741245 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.741157 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xjhz9\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9\") pod \"2430e841-b3af-48dc-bc0f-1064d583ab8a\" (UID: \"2430e841-b3af-48dc-bc0f-1064d583ab8a\") " Jul 09 15:31:58.741396 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.741344 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:58.742655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.742611 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:31:58.743920 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.743891 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:58.744181 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.744157 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:58.744255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.744201 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:58.744255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.744200 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9" (OuterVolumeSpecName: "kube-api-access-xjhz9") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "kube-api-access-xjhz9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:31:58.744359 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.744268 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:31:58.750054 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.750027 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2430e841-b3af-48dc-bc0f-1064d583ab8a" (UID: "2430e841-b3af-48dc-bc0f-1064d583ab8a"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841821 2581 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-certificates\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841853 2581 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-registry-tls\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841862 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xjhz9\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-kube-api-access-xjhz9\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841870 2581 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2430e841-b3af-48dc-bc0f-1064d583ab8a-bound-sa-token\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841879 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2430e841-b3af-48dc-bc0f-1064d583ab8a-trusted-ca\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841888 2581 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-image-registry-private-configuration\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841897 2581 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2430e841-b3af-48dc-bc0f-1064d583ab8a-ca-trust-extracted\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:58.841904 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:58.841905 2581 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2430e841-b3af-48dc-bc0f-1064d583ab8a-installation-pull-secrets\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:31:59.026321 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.026276 2581 generic.go:356] "Generic (PLEG): container finished" podID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerID="960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912" exitCode=0 Jul 09 15:31:59.026521 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.026329 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" Jul 09 15:31:59.026521 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.026360 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" event={"ID":"2430e841-b3af-48dc-bc0f-1064d583ab8a","Type":"ContainerDied","Data":"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912"} Jul 09 15:31:59.026521 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.026414 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-77c5b95f4d-6pj47" event={"ID":"2430e841-b3af-48dc-bc0f-1064d583ab8a","Type":"ContainerDied","Data":"be04df8e6dfe2739a002617c9aa8a9143fa46c8819aa33e13d8cfc531f898519"} Jul 09 15:31:59.026521 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.026435 2581 scope.go:117] "RemoveContainer" containerID="960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912" Jul 09 15:31:59.041033 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.041010 2581 scope.go:117] "RemoveContainer" containerID="960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912" Jul 09 15:31:59.041380 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:31:59.041359 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912\": container with ID starting with 960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912 not found: ID does not exist" containerID="960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912" Jul 09 15:31:59.041416 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.041392 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912"} err="failed to get container status \"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912\": rpc error: code = NotFound desc = could not find container \"960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912\": container with ID starting with 960323220cc61ce74e636b5430d34eebc162af6d95dac5e87ef1fe91462dd912 not found: ID does not exist" Jul 09 15:31:59.052403 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.052376 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:31:59.057745 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.057724 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-77c5b95f4d-6pj47"] Jul 09 15:31:59.812519 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:31:59.812467 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" path="/var/lib/kubelet/pods/2430e841-b3af-48dc-bc0f-1064d583ab8a/volumes" Jul 09 15:32:15.438096 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438057 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:15.438526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438350 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="alertmanager" containerID="cri-o://961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" gracePeriod=120 Jul 09 15:32:15.438526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438420 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-metric" containerID="cri-o://16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" gracePeriod=120 Jul 09 15:32:15.438526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438468 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-web" containerID="cri-o://65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" gracePeriod=120 Jul 09 15:32:15.438526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438476 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="config-reloader" containerID="cri-o://6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" gracePeriod=120 Jul 09 15:32:15.438732 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438519 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="prom-label-proxy" containerID="cri-o://ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" gracePeriod=120 Jul 09 15:32:15.438732 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:15.438571 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy" containerID="cri-o://c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" gracePeriod=120 Jul 09 15:32:16.098412 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098379 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" exitCode=0 Jul 09 15:32:16.098412 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098409 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" exitCode=0 Jul 09 15:32:16.098412 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098418 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" exitCode=0 Jul 09 15:32:16.098655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098428 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" exitCode=0 Jul 09 15:32:16.098655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098445 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601"} Jul 09 15:32:16.098655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098522 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185"} Jul 09 15:32:16.098655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098554 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b"} Jul 09 15:32:16.098655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.098578 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b"} Jul 09 15:32:16.789490 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.789427 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:16.889603 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889572 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889617 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889662 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889682 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889725 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889747 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.889777 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889766 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889862 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889911 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889945 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.889970 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.890008 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.890082 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.890032 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n9crc\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc\") pod \"0f59314f-683e-45d7-91f9-5d94e0c58b65\" (UID: \"0f59314f-683e-45d7-91f9-5d94e0c58b65\") " Jul 09 15:32:16.891883 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.890621 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:16.891883 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.891096 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:32:16.891883 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.891667 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:16.893320 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.893292 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out" (OuterVolumeSpecName: "config-out") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:32:16.894126 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.894096 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.894805 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.894773 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc" (OuterVolumeSpecName: "kube-api-access-n9crc") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "kube-api-access-n9crc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:16.894989 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.894959 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.896244 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.896209 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.896483 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.896446 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:32:16.896592 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.896532 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume" (OuterVolumeSpecName: "config-volume") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.896923 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.896889 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.899553 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.899464 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.908539 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.908490 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config" (OuterVolumeSpecName: "web-config") pod "0f59314f-683e-45d7-91f9-5d94e0c58b65" (UID: "0f59314f-683e-45d7-91f9-5d94e0c58b65"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:32:16.991699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991655 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n9crc\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-kube-api-access-n9crc\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991688 2581 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-cluster-tls-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991697 2581 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-out\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991707 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-main-tls\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991717 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991726 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991736 2581 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-web-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991744 2581 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-metrics-client-ca\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991751 2581 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-config-volume\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991759 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-main-db\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991767 2581 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0f59314f-683e-45d7-91f9-5d94e0c58b65-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991775 2581 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/0f59314f-683e-45d7-91f9-5d94e0c58b65-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:16.991953 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:16.991783 2581 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/0f59314f-683e-45d7-91f9-5d94e0c58b65-tls-assets\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:32:17.105334 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105239 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" exitCode=0 Jul 09 15:32:17.105334 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105271 2581 generic.go:356] "Generic (PLEG): container finished" podID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerID="65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" exitCode=0 Jul 09 15:32:17.105334 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105294 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f"} Jul 09 15:32:17.105334 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105323 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.105615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105369 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1"} Jul 09 15:32:17.105615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105409 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"0f59314f-683e-45d7-91f9-5d94e0c58b65","Type":"ContainerDied","Data":"e9569ac15c4e26ffa9431f3c86e0ff300fd45dbe06ccdbdc4ed9d2f5d9b9131d"} Jul 09 15:32:17.105615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.105442 2581 scope.go:117] "RemoveContainer" containerID="ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" Jul 09 15:32:17.113850 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.113834 2581 scope.go:117] "RemoveContainer" containerID="16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" Jul 09 15:32:17.121323 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.121306 2581 scope.go:117] "RemoveContainer" containerID="c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" Jul 09 15:32:17.128767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.128749 2581 scope.go:117] "RemoveContainer" containerID="65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" Jul 09 15:32:17.135802 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.135786 2581 scope.go:117] "RemoveContainer" containerID="6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" Jul 09 15:32:17.139382 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.139359 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:17.143434 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.143403 2581 scope.go:117] "RemoveContainer" containerID="961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" Jul 09 15:32:17.145901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.145882 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:17.151110 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.151093 2581 scope.go:117] "RemoveContainer" containerID="35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5" Jul 09 15:32:17.158331 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.158313 2581 scope.go:117] "RemoveContainer" containerID="ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" Jul 09 15:32:17.158617 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.158594 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601\": container with ID starting with ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601 not found: ID does not exist" containerID="ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" Jul 09 15:32:17.158702 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.158631 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601"} err="failed to get container status \"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601\": rpc error: code = NotFound desc = could not find container \"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601\": container with ID starting with ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601 not found: ID does not exist" Jul 09 15:32:17.158702 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.158655 2581 scope.go:117] "RemoveContainer" containerID="16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" Jul 09 15:32:17.158921 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.158904 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f\": container with ID starting with 16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f not found: ID does not exist" containerID="16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" Jul 09 15:32:17.158963 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.158924 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f"} err="failed to get container status \"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f\": rpc error: code = NotFound desc = could not find container \"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f\": container with ID starting with 16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f not found: ID does not exist" Jul 09 15:32:17.158963 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.158937 2581 scope.go:117] "RemoveContainer" containerID="c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" Jul 09 15:32:17.159128 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.159115 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185\": container with ID starting with c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185 not found: ID does not exist" containerID="c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" Jul 09 15:32:17.159163 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159131 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185"} err="failed to get container status \"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185\": rpc error: code = NotFound desc = could not find container \"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185\": container with ID starting with c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185 not found: ID does not exist" Jul 09 15:32:17.159163 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159143 2581 scope.go:117] "RemoveContainer" containerID="65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" Jul 09 15:32:17.159332 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.159319 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1\": container with ID starting with 65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1 not found: ID does not exist" containerID="65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" Jul 09 15:32:17.159384 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159334 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1"} err="failed to get container status \"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1\": rpc error: code = NotFound desc = could not find container \"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1\": container with ID starting with 65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1 not found: ID does not exist" Jul 09 15:32:17.159384 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159353 2581 scope.go:117] "RemoveContainer" containerID="6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" Jul 09 15:32:17.159590 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.159575 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b\": container with ID starting with 6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b not found: ID does not exist" containerID="6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" Jul 09 15:32:17.159632 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159594 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b"} err="failed to get container status \"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b\": rpc error: code = NotFound desc = could not find container \"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b\": container with ID starting with 6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b not found: ID does not exist" Jul 09 15:32:17.159632 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159605 2581 scope.go:117] "RemoveContainer" containerID="961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" Jul 09 15:32:17.159823 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.159804 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b\": container with ID starting with 961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b not found: ID does not exist" containerID="961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" Jul 09 15:32:17.159865 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159828 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b"} err="failed to get container status \"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b\": rpc error: code = NotFound desc = could not find container \"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b\": container with ID starting with 961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b not found: ID does not exist" Jul 09 15:32:17.159865 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.159842 2581 scope.go:117] "RemoveContainer" containerID="35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5" Jul 09 15:32:17.160053 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:32:17.160036 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5\": container with ID starting with 35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5 not found: ID does not exist" containerID="35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5" Jul 09 15:32:17.160092 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160060 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5"} err="failed to get container status \"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5\": rpc error: code = NotFound desc = could not find container \"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5\": container with ID starting with 35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5 not found: ID does not exist" Jul 09 15:32:17.160092 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160074 2581 scope.go:117] "RemoveContainer" containerID="ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601" Jul 09 15:32:17.160268 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160251 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601"} err="failed to get container status \"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601\": rpc error: code = NotFound desc = could not find container \"ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601\": container with ID starting with ca1526d5f4ec1ab1e46f9c37a92a6f36c87a0f9db9f1f0827799c281d0def601 not found: ID does not exist" Jul 09 15:32:17.160325 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160269 2581 scope.go:117] "RemoveContainer" containerID="16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f" Jul 09 15:32:17.160465 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160445 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f"} err="failed to get container status \"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f\": rpc error: code = NotFound desc = could not find container \"16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f\": container with ID starting with 16751a3d6ead5b54e7d11c1e301a4b76dd31bf3cac0e6ea0cf0d4c28c692357f not found: ID does not exist" Jul 09 15:32:17.160465 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160461 2581 scope.go:117] "RemoveContainer" containerID="c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185" Jul 09 15:32:17.160686 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160670 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185"} err="failed to get container status \"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185\": rpc error: code = NotFound desc = could not find container \"c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185\": container with ID starting with c62d11466f7799d5e2f186ef0006cffac0d1c38937f83caa7dfc71413d38d185 not found: ID does not exist" Jul 09 15:32:17.160686 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160685 2581 scope.go:117] "RemoveContainer" containerID="65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1" Jul 09 15:32:17.160890 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160871 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1"} err="failed to get container status \"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1\": rpc error: code = NotFound desc = could not find container \"65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1\": container with ID starting with 65fab94012fee0218f0096e33671509426ee68297fad45f090d0e0580ba0c7b1 not found: ID does not exist" Jul 09 15:32:17.160937 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.160893 2581 scope.go:117] "RemoveContainer" containerID="6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b" Jul 09 15:32:17.161086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.161070 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b"} err="failed to get container status \"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b\": rpc error: code = NotFound desc = could not find container \"6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b\": container with ID starting with 6b501fa7cc89e8acbf90d7fb78b8cca0c20d1a0e333d941bda6b9432dd703d0b not found: ID does not exist" Jul 09 15:32:17.161132 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.161087 2581 scope.go:117] "RemoveContainer" containerID="961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b" Jul 09 15:32:17.161314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.161294 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b"} err="failed to get container status \"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b\": rpc error: code = NotFound desc = could not find container \"961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b\": container with ID starting with 961f61eb8fd7ae504d72ced846b28bbdb94d5c7bcce6197b517db05e92423f7b not found: ID does not exist" Jul 09 15:32:17.161314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.161314 2581 scope.go:117] "RemoveContainer" containerID="35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5" Jul 09 15:32:17.161655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.161635 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5"} err="failed to get container status \"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5\": rpc error: code = NotFound desc = could not find container \"35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5\": container with ID starting with 35077a45eabe72dd75c86ddd703270460ea9944259b22faa5bed566123f79bc5 not found: ID does not exist" Jul 09 15:32:17.178158 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178128 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:17.178480 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178464 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178483 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178514 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="config-reloader" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178524 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="config-reloader" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178539 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="alertmanager" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178547 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="alertmanager" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178562 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerName="console" Jul 09 15:32:17.178579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178573 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerName="console" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178585 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-web" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178593 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-web" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178613 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="init-config-reloader" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178622 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="init-config-reloader" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178633 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="prom-label-proxy" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178641 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="prom-label-proxy" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178651 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerName="registry" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178659 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerName="registry" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178671 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-metric" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178679 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-metric" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178766 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="e07c3b4c-e879-42f3-a205-a838aac8b4ee" containerName="console" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178779 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-metric" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178789 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="2430e841-b3af-48dc-bc0f-1064d583ab8a" containerName="registry" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178798 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="config-reloader" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178807 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy-web" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178817 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="prom-label-proxy" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178827 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="kube-rbac-proxy" Jul 09 15:32:17.178901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.178837 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" containerName="alertmanager" Jul 09 15:32:17.182110 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.182086 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.193211 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.193184 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 15:32:17.193624 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.193607 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 15:32:17.193826 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.193812 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 15:32:17.194819 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.194799 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 15:32:17.194921 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.194832 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-zrtnq\"" Jul 09 15:32:17.194985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.194970 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 15:32:17.195208 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.195196 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 15:32:17.195270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.195224 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 15:32:17.195321 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.195306 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 15:32:17.203660 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.203636 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 15:32:17.211063 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.211035 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:17.294479 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294438 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294479 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294478 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294603 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294634 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294652 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2f2v\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-kube-api-access-b2f2v\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294722 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294771 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294826 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294854 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294882 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294919 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.294985 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.294948 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.395865 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.395829 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.395872 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.395895 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2f2v\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-kube-api-access-b2f2v\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.395931 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.395972 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396005 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396055 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396034 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396062 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396089 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396112 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396146 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396169 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.396328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.396207 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.397463 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.397434 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.397893 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.397871 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399246 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399218 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-tls-assets\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399246 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399234 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-web-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399251 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-out\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399420 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399316 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399602 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399548 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399602 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399594 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.399840 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.399819 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9ac9bd98-0251-4de5-b09b-13005fbda71a-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.400669 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.400649 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-config-volume\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.401144 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.401127 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/9ac9bd98-0251-4de5-b09b-13005fbda71a-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.405418 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.405400 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2f2v\" (UniqueName: \"kubernetes.io/projected/9ac9bd98-0251-4de5-b09b-13005fbda71a-kube-api-access-b2f2v\") pod \"alertmanager-main-0\" (UID: \"9ac9bd98-0251-4de5-b09b-13005fbda71a\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.491172 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.491136 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 15:32:17.641373 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.641337 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 15:32:17.645334 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:32:17.645302 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ac9bd98_0251_4de5_b09b_13005fbda71a.slice/crio-30407bde2120d0d531a7e15ada409f8e2dceb850f57e5e5a95f5132ec11ec582 WatchSource:0}: Error finding container 30407bde2120d0d531a7e15ada409f8e2dceb850f57e5e5a95f5132ec11ec582: Status 404 returned error can't find the container with id 30407bde2120d0d531a7e15ada409f8e2dceb850f57e5e5a95f5132ec11ec582 Jul 09 15:32:17.814992 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:17.814962 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f59314f-683e-45d7-91f9-5d94e0c58b65" path="/var/lib/kubelet/pods/0f59314f-683e-45d7-91f9-5d94e0c58b65/volumes" Jul 09 15:32:18.110663 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:18.110569 2581 generic.go:356] "Generic (PLEG): container finished" podID="9ac9bd98-0251-4de5-b09b-13005fbda71a" containerID="551a9c4b394066e723818a2e26010cca02cc7141eabe3b4093c2d11f408a9d63" exitCode=0 Jul 09 15:32:18.110828 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:18.110657 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerDied","Data":"551a9c4b394066e723818a2e26010cca02cc7141eabe3b4093c2d11f408a9d63"} Jul 09 15:32:18.110828 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:18.110725 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"30407bde2120d0d531a7e15ada409f8e2dceb850f57e5e5a95f5132ec11ec582"} Jul 09 15:32:19.117694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117654 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"41ff1883caee7a8b50098e1e26804fa02dc656eca08244cc493e3421cbd9a658"} Jul 09 15:32:19.118090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117739 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"6cba6d156e17bdf9d94e9087d267470bac74c545b625e47f7c69d1c6d2687867"} Jul 09 15:32:19.118090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117783 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"99b1d4faadb852ae567e07450ca6b4b9d7575573d0b60f122c8565f5de3cabff"} Jul 09 15:32:19.118090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117822 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"33ad25649f631e0ce48232207e09e036a06c4f4c8a713a297e020450338ab52d"} Jul 09 15:32:19.118090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117857 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"8269be4c3472c6388a6e952faf5872097cccdaa21a68b4b593dec27aa00f35d3"} Jul 09 15:32:19.118090 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.117896 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"9ac9bd98-0251-4de5-b09b-13005fbda71a","Type":"ContainerStarted","Data":"f60c1ded42040b2fc2899ff03390e96d70fa7dc0ce31a21d5550f080aa305da7"} Jul 09 15:32:19.149318 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.149268 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.133030213 podStartE2EDuration="2.149247201s" totalImagesPullingTime="0s" totalInitContainerRuntime="16.216988ms" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:19.149068949 +0000 UTC m=+361.864346467" watchObservedRunningTime="2026-07-09 15:32:19.149247201 +0000 UTC m=+361.864524717" Jul 09 15:32:19.453927 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.453883 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-79fb87d797-6zh59"] Jul 09 15:32:19.456796 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.456766 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.459744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.459716 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 15:32:19.459908 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.459723 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-thb6h\"" Jul 09 15:32:19.460109 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.460083 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 15:32:19.460401 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.460386 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 15:32:19.460451 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.460391 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 15:32:19.460620 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.460603 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 15:32:19.475308 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.475281 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 15:32:19.480868 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.480843 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79fb87d797-6zh59"] Jul 09 15:32:19.613957 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.613897 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9769\" (UniqueName: \"kubernetes.io/projected/03162a46-3b08-4a29-90ff-572ea8787348-kube-api-access-z9769\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614164 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.613970 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614164 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614006 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614164 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614082 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614164 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-federate-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614391 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614170 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-metrics-client-ca\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614391 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614235 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-serving-certs-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.614391 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.614302 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715030 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.714932 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715030 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.714976 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715030 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715020 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715049 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-federate-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715078 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-metrics-client-ca\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715095 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-serving-certs-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715123 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.715314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715246 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9769\" (UniqueName: \"kubernetes.io/projected/03162a46-3b08-4a29-90ff-572ea8787348-kube-api-access-z9769\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.716016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.715968 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-metrics-client-ca\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.716140 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.716113 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-serving-certs-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.716340 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.716317 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-trusted-ca-bundle\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.717831 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.717808 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.717901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.717852 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-federate-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.718192 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.718166 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-secret-telemeter-client\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.718277 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.718258 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/03162a46-3b08-4a29-90ff-572ea8787348-telemeter-client-tls\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.725247 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.725223 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9769\" (UniqueName: \"kubernetes.io/projected/03162a46-3b08-4a29-90ff-572ea8787348-kube-api-access-z9769\") pod \"telemeter-client-79fb87d797-6zh59\" (UID: \"03162a46-3b08-4a29-90ff-572ea8787348\") " pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.768308 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.768277 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" Jul 09 15:32:19.955750 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.955725 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-79fb87d797-6zh59"] Jul 09 15:32:19.957248 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:32:19.957220 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03162a46_3b08_4a29_90ff_572ea8787348.slice/crio-771f47c85769fc40f4da731950d799568234ae7995bc3a20c1503f285ef0430a WatchSource:0}: Error finding container 771f47c85769fc40f4da731950d799568234ae7995bc3a20c1503f285ef0430a: Status 404 returned error can't find the container with id 771f47c85769fc40f4da731950d799568234ae7995bc3a20c1503f285ef0430a Jul 09 15:32:19.959286 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:19.959269 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:32:20.125569 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:20.125430 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" event={"ID":"03162a46-3b08-4a29-90ff-572ea8787348","Type":"ContainerStarted","Data":"771f47c85769fc40f4da731950d799568234ae7995bc3a20c1503f285ef0430a"} Jul 09 15:32:25.149226 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.149193 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" event={"ID":"03162a46-3b08-4a29-90ff-572ea8787348","Type":"ContainerStarted","Data":"ffd23bd12966b1861ff0237c983fb9695318632b8761da596639171723187142"} Jul 09 15:32:25.149624 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.149288 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" event={"ID":"03162a46-3b08-4a29-90ff-572ea8787348","Type":"ContainerStarted","Data":"e4240536cb7a2934f25e62d55345c4d3ab2002e6aa166b874d8743d3d0081084"} Jul 09 15:32:25.149624 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.149308 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" event={"ID":"03162a46-3b08-4a29-90ff-572ea8787348","Type":"ContainerStarted","Data":"428ffb536a54e0b3ae3cb39a8b6d8cd234ea95c8d82b1c447ab2d136a6207650"} Jul 09 15:32:25.173314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.173260 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-79fb87d797-6zh59" podStartSLOduration=1.321430425 podStartE2EDuration="6.17324437s" totalImagesPullingTime="4.851813945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:25.170983952 +0000 UTC m=+367.886261469" watchObservedRunningTime="2026-07-09 15:32:25.17324437 +0000 UTC m=+367.888521886" Jul 09 15:32:25.892604 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.892570 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:32:25.895713 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.895684 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:25.898810 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.898784 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 15:32:25.898978 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.898784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 15:32:25.898978 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.898784 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 15:32:25.899882 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.899865 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 15:32:25.900310 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.900270 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 15:32:25.900413 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.900330 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-z6sb7\"" Jul 09 15:32:25.904771 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.904746 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 15:32:25.916275 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:25.916249 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:32:26.075362 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075315 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075362 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075362 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075392 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075519 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-67h5h\" (UniqueName: \"kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075547 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075568 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.075631 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.075585 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176224 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176267 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176327 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176304 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176355 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-67h5h\" (UniqueName: \"kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176377 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176402 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.176967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.176430 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.177178 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.177081 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.177257 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.177233 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.177390 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.177364 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.177825 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.177802 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.178927 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.178910 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.179019 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.179002 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.186686 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.186666 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-67h5h\" (UniqueName: \"kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h\") pod \"console-79b8b96f49-pt7s2\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.207615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.207583 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:26.345286 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:26.345252 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:32:26.348319 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:32:26.348293 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5af502e_655e_4912_a28b_79d377a995e8.slice/crio-e067f10ff880cb092f30e90ed85ca5855f45a8921951053e1bb2f4c75f9f75b0 WatchSource:0}: Error finding container e067f10ff880cb092f30e90ed85ca5855f45a8921951053e1bb2f4c75f9f75b0: Status 404 returned error can't find the container with id e067f10ff880cb092f30e90ed85ca5855f45a8921951053e1bb2f4c75f9f75b0 Jul 09 15:32:27.159025 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:27.158988 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b8b96f49-pt7s2" event={"ID":"b5af502e-655e-4912-a28b-79d377a995e8","Type":"ContainerStarted","Data":"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0"} Jul 09 15:32:27.159177 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:27.159037 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b8b96f49-pt7s2" event={"ID":"b5af502e-655e-4912-a28b-79d377a995e8","Type":"ContainerStarted","Data":"e067f10ff880cb092f30e90ed85ca5855f45a8921951053e1bb2f4c75f9f75b0"} Jul 09 15:32:27.181289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:27.181233 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-79b8b96f49-pt7s2" podStartSLOduration=2.181217462 podStartE2EDuration="2.181217462s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:32:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:32:27.181026916 +0000 UTC m=+369.896304432" watchObservedRunningTime="2026-07-09 15:32:27.181217462 +0000 UTC m=+369.896494978" Jul 09 15:32:36.207765 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:36.207728 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:36.208214 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:36.207790 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:36.212644 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:36.212618 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:32:37.203332 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:32:37.203308 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:34:05.235633 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.235556 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:34:05.237841 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.237825 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244116 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244169 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244221 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244252 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244275 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244308 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.244386 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.244365 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbqm8\" (UniqueName: \"kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.258002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.257972 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:34:05.344894 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.344852 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.344912 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbqm8\" (UniqueName: \"kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.344957 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.344988 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345054 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345074 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345740 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345739 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.345945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.345828 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.346095 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.346078 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.347665 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.347645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.347746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.347660 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.355793 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.355769 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbqm8\" (UniqueName: \"kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8\") pod \"console-7d8976c599-fxbhm\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.547007 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.546914 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:05.688914 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:05.688880 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:34:05.691988 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:34:05.691961 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddaddd0a2_3d9e_4909_940c_3f1074417a34.slice/crio-66495474abff5f50455b5729822605cd191579ab8ef47fba84b8af1d4998f83a WatchSource:0}: Error finding container 66495474abff5f50455b5729822605cd191579ab8ef47fba84b8af1d4998f83a: Status 404 returned error can't find the container with id 66495474abff5f50455b5729822605cd191579ab8ef47fba84b8af1d4998f83a Jul 09 15:34:06.572052 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:06.572008 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8976c599-fxbhm" event={"ID":"daddd0a2-3d9e-4909-940c-3f1074417a34","Type":"ContainerStarted","Data":"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f"} Jul 09 15:34:06.572437 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:06.572075 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8976c599-fxbhm" event={"ID":"daddd0a2-3d9e-4909-940c-3f1074417a34","Type":"ContainerStarted","Data":"66495474abff5f50455b5729822605cd191579ab8ef47fba84b8af1d4998f83a"} Jul 09 15:34:06.593855 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:06.593802 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8976c599-fxbhm" podStartSLOduration=1.593785675 podStartE2EDuration="1.593785675s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:34:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:34:06.591896258 +0000 UTC m=+469.307173775" watchObservedRunningTime="2026-07-09 15:34:06.593785675 +0000 UTC m=+469.309063192" Jul 09 15:34:15.547579 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:15.547536 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:15.547970 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:15.547618 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:15.552159 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:15.552135 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:15.612021 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:15.611994 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:34:15.668368 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:15.668334 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:34:40.688936 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:40.688887 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-79b8b96f49-pt7s2" podUID="b5af502e-655e-4912-a28b-79d377a995e8" containerName="console" containerID="cri-o://8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0" gracePeriod=15 Jul 09 15:34:40.936314 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:40.936290 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:34:41.050891 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.050802 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.050891 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.050844 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.050891 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.050891 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.051162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.050921 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.051162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.050939 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-67h5h\" (UniqueName: \"kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.051162 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051123 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.051311 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051165 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config\") pod \"b5af502e-655e-4912-a28b-79d377a995e8\" (UID: \"b5af502e-655e-4912-a28b-79d377a995e8\") " Jul 09 15:34:41.051311 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051269 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:34:41.051436 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051330 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca" (OuterVolumeSpecName: "service-ca") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:34:41.051436 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051386 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:34:41.051608 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051590 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-trusted-ca-bundle\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.051670 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051610 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-service-ca\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.051670 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051620 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-oauth-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.051670 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.051624 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config" (OuterVolumeSpecName: "console-config") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:34:41.053349 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.053323 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h" (OuterVolumeSpecName: "kube-api-access-67h5h") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "kube-api-access-67h5h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:34:41.053349 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.053328 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:34:41.053349 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.053343 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b5af502e-655e-4912-a28b-79d377a995e8" (UID: "b5af502e-655e-4912-a28b-79d377a995e8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:34:41.152265 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.152232 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.152265 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.152262 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b5af502e-655e-4912-a28b-79d377a995e8-console-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.152265 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.152272 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b5af502e-655e-4912-a28b-79d377a995e8-console-oauth-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.152484 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.152281 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-67h5h\" (UniqueName: \"kubernetes.io/projected/b5af502e-655e-4912-a28b-79d377a995e8-kube-api-access-67h5h\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:34:41.718093 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.718063 2581 generic.go:356] "Generic (PLEG): container finished" podID="b5af502e-655e-4912-a28b-79d377a995e8" containerID="8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0" exitCode=0 Jul 09 15:34:41.718526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.718126 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b8b96f49-pt7s2" event={"ID":"b5af502e-655e-4912-a28b-79d377a995e8","Type":"ContainerDied","Data":"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0"} Jul 09 15:34:41.718526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.718190 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-79b8b96f49-pt7s2" event={"ID":"b5af502e-655e-4912-a28b-79d377a995e8","Type":"ContainerDied","Data":"e067f10ff880cb092f30e90ed85ca5855f45a8921951053e1bb2f4c75f9f75b0"} Jul 09 15:34:41.718526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.718125 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-79b8b96f49-pt7s2" Jul 09 15:34:41.718526 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.718210 2581 scope.go:117] "RemoveContainer" containerID="8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0" Jul 09 15:34:41.727519 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.727484 2581 scope.go:117] "RemoveContainer" containerID="8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0" Jul 09 15:34:41.727817 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:34:41.727799 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0\": container with ID starting with 8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0 not found: ID does not exist" containerID="8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0" Jul 09 15:34:41.727859 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.727826 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0"} err="failed to get container status \"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0\": rpc error: code = NotFound desc = could not find container \"8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0\": container with ID starting with 8331bec551386004687151dccfbfd84e042522e7cea45c4dd17503b56a1c9fe0 not found: ID does not exist" Jul 09 15:34:41.740018 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.739994 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:34:41.744000 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.743980 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-79b8b96f49-pt7s2"] Jul 09 15:34:41.813786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:34:41.813754 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b5af502e-655e-4912-a28b-79d377a995e8" path="/var/lib/kubelet/pods/b5af502e-655e-4912-a28b-79d377a995e8/volumes" Jul 09 15:36:17.729799 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:36:17.729768 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:36:17.730254 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:36:17.729880 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:37:09.923134 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.923056 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj"] Jul 09 15:37:09.925490 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.923424 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b5af502e-655e-4912-a28b-79d377a995e8" containerName="console" Jul 09 15:37:09.925490 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.923435 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="b5af502e-655e-4912-a28b-79d377a995e8" containerName="console" Jul 09 15:37:09.925490 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.923489 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="b5af502e-655e-4912-a28b-79d377a995e8" containerName="console" Jul 09 15:37:09.926426 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.926411 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:09.929704 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.929670 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 09 15:37:09.929808 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.929758 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 09 15:37:09.930729 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.930710 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-f95sk\"" Jul 09 15:37:09.951300 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:09.951271 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj"] Jul 09 15:37:10.019762 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.019729 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.019762 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.019768 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prltk\" (UniqueName: \"kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.020008 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.019815 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.120404 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.120372 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.120588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.120423 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.120588 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.120539 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prltk\" (UniqueName: \"kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.120729 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.120715 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.120817 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.120796 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.130062 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.130037 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prltk\" (UniqueName: \"kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk\") pod \"74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.235841 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.235733 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:10.371485 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:10.371459 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj"] Jul 09 15:37:10.373418 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:37:10.373393 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d7d9009_004d_4e3f_93fa_a399e398d490.slice/crio-3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f WatchSource:0}: Error finding container 3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f: Status 404 returned error can't find the container with id 3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f Jul 09 15:37:11.325084 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:11.325046 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" event={"ID":"0d7d9009-004d-4e3f-93fa-a399e398d490","Type":"ContainerStarted","Data":"3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f"} Jul 09 15:37:18.359272 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:18.359233 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerID="30cc2adbb5219436494d56fa964b0be261ed65122bda92f77fbf95008d76c983" exitCode=0 Jul 09 15:37:18.359685 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:18.359327 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" event={"ID":"0d7d9009-004d-4e3f-93fa-a399e398d490","Type":"ContainerDied","Data":"30cc2adbb5219436494d56fa964b0be261ed65122bda92f77fbf95008d76c983"} Jul 09 15:37:22.378940 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:22.378909 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerID="c0bcc41005e899fdb24a24cc03729a03a39290a032e81ddc05ab21aa3da59817" exitCode=0 Jul 09 15:37:22.379313 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:22.378968 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" event={"ID":"0d7d9009-004d-4e3f-93fa-a399e398d490","Type":"ContainerDied","Data":"c0bcc41005e899fdb24a24cc03729a03a39290a032e81ddc05ab21aa3da59817"} Jul 09 15:37:22.379949 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:22.379933 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:37:25.997788 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:25.997748 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6849bd8dff-rpkj5"] Jul 09 15:37:26.004462 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.004435 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.013564 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.013540 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6849bd8dff-rpkj5"] Jul 09 15:37:26.163533 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163474 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-oauth-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163533 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163535 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163565 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-oauth-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163664 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fqc82\" (UniqueName: \"kubernetes.io/projected/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-kube-api-access-fqc82\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163709 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-trusted-ca-bundle\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163767 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163753 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-service-ca\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.163969 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.163804 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.264966 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fqc82\" (UniqueName: \"kubernetes.io/projected/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-kube-api-access-fqc82\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265011 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-trusted-ca-bundle\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265030 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-service-ca\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265323 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265166 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265323 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265262 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-oauth-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265323 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265295 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265323 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265311 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-oauth-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265966 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-service-ca\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.265966 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.265907 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-trusted-ca-bundle\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.266225 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.266063 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-oauth-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.266399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.266378 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.268353 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.268333 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-oauth-config\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.268623 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.268601 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-console-serving-cert\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.276668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.276645 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fqc82\" (UniqueName: \"kubernetes.io/projected/fcfa57d5-a79d-43ce-90d1-efff318ff1e6-kube-api-access-fqc82\") pod \"console-6849bd8dff-rpkj5\" (UID: \"fcfa57d5-a79d-43ce-90d1-efff318ff1e6\") " pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.315616 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.315576 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:26.475460 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:26.475432 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6849bd8dff-rpkj5"] Jul 09 15:37:26.478306 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:37:26.478279 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcfa57d5_a79d_43ce_90d1_efff318ff1e6.slice/crio-8a801afb15e5f170ab3ee45802f2ca208a8fe39d7248478b99271c4eaaefd232 WatchSource:0}: Error finding container 8a801afb15e5f170ab3ee45802f2ca208a8fe39d7248478b99271c4eaaefd232: Status 404 returned error can't find the container with id 8a801afb15e5f170ab3ee45802f2ca208a8fe39d7248478b99271c4eaaefd232 Jul 09 15:37:27.406050 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:27.406013 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6849bd8dff-rpkj5" event={"ID":"fcfa57d5-a79d-43ce-90d1-efff318ff1e6","Type":"ContainerStarted","Data":"b933236510b3cb988629f8129bae74f033cead6dd6fa6b0780cea160f18316a1"} Jul 09 15:37:27.406529 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:27.406067 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6849bd8dff-rpkj5" event={"ID":"fcfa57d5-a79d-43ce-90d1-efff318ff1e6","Type":"ContainerStarted","Data":"8a801afb15e5f170ab3ee45802f2ca208a8fe39d7248478b99271c4eaaefd232"} Jul 09 15:37:27.429270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:27.429211 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6849bd8dff-rpkj5" podStartSLOduration=2.429191802 podStartE2EDuration="2.429191802s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:27.427306289 +0000 UTC m=+670.142583808" watchObservedRunningTime="2026-07-09 15:37:27.429191802 +0000 UTC m=+670.144469322" Jul 09 15:37:30.423011 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:30.422976 2581 generic.go:356] "Generic (PLEG): container finished" podID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerID="443392e3df2a3e2b117354e4f4611b6305f01899f05b9abad72707c3e312d251" exitCode=0 Jul 09 15:37:30.423402 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:30.423018 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" event={"ID":"0d7d9009-004d-4e3f-93fa-a399e398d490","Type":"ContainerDied","Data":"443392e3df2a3e2b117354e4f4611b6305f01899f05b9abad72707c3e312d251"} Jul 09 15:37:31.581429 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.581396 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:31.711617 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.711519 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prltk\" (UniqueName: \"kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk\") pod \"0d7d9009-004d-4e3f-93fa-a399e398d490\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " Jul 09 15:37:31.711617 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.711592 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util\") pod \"0d7d9009-004d-4e3f-93fa-a399e398d490\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " Jul 09 15:37:31.711847 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.711629 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle\") pod \"0d7d9009-004d-4e3f-93fa-a399e398d490\" (UID: \"0d7d9009-004d-4e3f-93fa-a399e398d490\") " Jul 09 15:37:31.712204 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.712179 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle" (OuterVolumeSpecName: "bundle") pod "0d7d9009-004d-4e3f-93fa-a399e398d490" (UID: "0d7d9009-004d-4e3f-93fa-a399e398d490"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:31.713813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.713789 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk" (OuterVolumeSpecName: "kube-api-access-prltk") pod "0d7d9009-004d-4e3f-93fa-a399e398d490" (UID: "0d7d9009-004d-4e3f-93fa-a399e398d490"). InnerVolumeSpecName "kube-api-access-prltk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:37:31.715708 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.715685 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util" (OuterVolumeSpecName: "util") pod "0d7d9009-004d-4e3f-93fa-a399e398d490" (UID: "0d7d9009-004d-4e3f-93fa-a399e398d490"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:37:31.812126 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.812097 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prltk\" (UniqueName: \"kubernetes.io/projected/0d7d9009-004d-4e3f-93fa-a399e398d490-kube-api-access-prltk\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:37:31.812126 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.812119 2581 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-util\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:37:31.812126 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:31.812128 2581 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0d7d9009-004d-4e3f-93fa-a399e398d490-bundle\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:37:32.437734 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:32.437700 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" Jul 09 15:37:32.437913 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:32.437701 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/74e94af6ec69867d65f1d90648440bdc4f0845d5e32c4818a460ebb589cs5xj" event={"ID":"0d7d9009-004d-4e3f-93fa-a399e398d490","Type":"ContainerDied","Data":"3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f"} Jul 09 15:37:32.437913 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:32.437852 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3c7c9b48d7c98bdfdecfd3861edd4e24b4a8ccf1a568deaf0d2bb02064ff2d0f" Jul 09 15:37:36.316168 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:36.316113 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:36.316556 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:36.316199 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:36.321086 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:36.321062 2581 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:36.459013 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:36.458988 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6849bd8dff-rpkj5" Jul 09 15:37:36.512901 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:36.512866 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055053 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g"] Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055875 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="pull" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055898 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="pull" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055945 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="extract" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055954 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="extract" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055969 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="util" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.055983 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="util" Jul 09 15:37:38.057694 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.056171 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="0d7d9009-004d-4e3f-93fa-a399e398d490" containerName="extract" Jul 09 15:37:38.059680 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.059481 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.062817 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.062795 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"custom-metrics-autoscaler-operator-dockercfg-ls8ss\"" Jul 09 15:37:38.062951 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.062846 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"kedaorg-certs\"" Jul 09 15:37:38.062951 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.062846 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"openshift-service-ca.crt\"" Jul 09 15:37:38.062951 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.062844 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"kube-root-ca.crt\"" Jul 09 15:37:38.072149 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.072123 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g"] Jul 09 15:37:38.165615 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.165578 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qv99x\" (UniqueName: \"kubernetes.io/projected/73810aa0-6c5c-4a4b-b3c8-788a50f59767-kube-api-access-qv99x\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.165786 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.165625 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/73810aa0-6c5c-4a4b-b3c8-788a50f59767-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.266799 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.266756 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qv99x\" (UniqueName: \"kubernetes.io/projected/73810aa0-6c5c-4a4b-b3c8-788a50f59767-kube-api-access-qv99x\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.266799 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.266806 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/73810aa0-6c5c-4a4b-b3c8-788a50f59767-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.269363 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.269344 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/secret/73810aa0-6c5c-4a4b-b3c8-788a50f59767-certificates\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.277007 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.276980 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qv99x\" (UniqueName: \"kubernetes.io/projected/73810aa0-6c5c-4a4b-b3c8-788a50f59767-kube-api-access-qv99x\") pod \"custom-metrics-autoscaler-operator-75f7c5f8f-ml79g\" (UID: \"73810aa0-6c5c-4a4b-b3c8-788a50f59767\") " pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.370676 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.370587 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:38.509829 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:38.509799 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g"] Jul 09 15:37:38.511324 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:37:38.511294 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod73810aa0_6c5c_4a4b_b3c8_788a50f59767.slice/crio-c6dd0d3a2da55396c6e8242484bea522a706511096a9008934734580f79e82e8 WatchSource:0}: Error finding container c6dd0d3a2da55396c6e8242484bea522a706511096a9008934734580f79e82e8: Status 404 returned error can't find the container with id c6dd0d3a2da55396c6e8242484bea522a706511096a9008934734580f79e82e8 Jul 09 15:37:39.469966 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:39.469926 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" event={"ID":"73810aa0-6c5c-4a4b-b3c8-788a50f59767","Type":"ContainerStarted","Data":"c6dd0d3a2da55396c6e8242484bea522a706511096a9008934734580f79e82e8"} Jul 09 15:37:42.426779 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.426739 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-keda/keda-operator-68bff59c-n599v"] Jul 09 15:37:42.429263 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.429245 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.432962 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.432931 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-keda\"/\"keda-ocp-cabundle\"" Jul 09 15:37:42.432962 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.432940 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-certs\"" Jul 09 15:37:42.433172 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.433038 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-keda\"/\"keda-operator-dockercfg-mbjgl\"" Jul 09 15:37:42.445632 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.445611 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-n599v"] Jul 09 15:37:42.492407 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.492371 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" event={"ID":"73810aa0-6c5c-4a4b-b3c8-788a50f59767","Type":"ContainerStarted","Data":"89b23f4f6d3a81f65981ef9310059defa79e479f46a67f2ce0ca301bb02edecc"} Jul 09 15:37:42.492596 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.492439 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:37:42.503004 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.502974 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.503154 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.503012 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f5f5a3a0-098d-481f-8c22-e2656ab17d31-cabundle0\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.503154 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.503064 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mz4qs\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-kube-api-access-mz4qs\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.514922 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.514875 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" podStartSLOduration=1.4220844129999999 podStartE2EDuration="4.514855331s" totalImagesPullingTime="3.092770918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:42.512517284 +0000 UTC m=+685.227794802" watchObservedRunningTime="2026-07-09 15:37:42.514855331 +0000 UTC m=+685.230132847" Jul 09 15:37:42.603783 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.603739 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.603783 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.603786 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f5f5a3a0-098d-481f-8c22-e2656ab17d31-cabundle0\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.604048 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.603820 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mz4qs\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-kube-api-access-mz4qs\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.604048 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:37:42.603905 2581 secret.go:281] references non-existent secret key: ca.crt Jul 09 15:37:42.604048 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:37:42.603931 2581 projected.go:279] Couldn't get secret payload openshift-keda/kedaorg-certs: references non-existent secret key: ca.crt Jul 09 15:37:42.604048 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:37:42.603944 2581 projected.go:196] Error preparing data for projected volume certificates for pod openshift-keda/keda-operator-68bff59c-n599v: references non-existent secret key: ca.crt Jul 09 15:37:42.604048 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:37:42.604013 2581 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates podName:f5f5a3a0-098d-481f-8c22-e2656ab17d31 nodeName:}" failed. No retries permitted until 2026-07-09 15:37:43.103992643 +0000 UTC m=+685.819270151 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "certificates" (UniqueName: "kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates") pod "keda-operator-68bff59c-n599v" (UID: "f5f5a3a0-098d-481f-8c22-e2656ab17d31") : references non-existent secret key: ca.crt Jul 09 15:37:42.604622 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.604602 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cabundle0\" (UniqueName: \"kubernetes.io/configmap/f5f5a3a0-098d-481f-8c22-e2656ab17d31-cabundle0\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:42.616639 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:42.616611 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mz4qs\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-kube-api-access-mz4qs\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:43.109699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:43.109659 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:43.112300 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:43.112270 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"certificates\" (UniqueName: \"kubernetes.io/projected/f5f5a3a0-098d-481f-8c22-e2656ab17d31-certificates\") pod \"keda-operator-68bff59c-n599v\" (UID: \"f5f5a3a0-098d-481f-8c22-e2656ab17d31\") " pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:43.339661 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:43.339619 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:43.504519 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:43.504472 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-keda/keda-operator-68bff59c-n599v"] Jul 09 15:37:43.505629 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:37:43.505599 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5f5a3a0_098d_481f_8c22_e2656ab17d31.slice/crio-ce419823ae599393c7040d9f6fbe077948f3fed87fa1dcd97d2381e2235c6e43 WatchSource:0}: Error finding container ce419823ae599393c7040d9f6fbe077948f3fed87fa1dcd97d2381e2235c6e43: Status 404 returned error can't find the container with id ce419823ae599393c7040d9f6fbe077948f3fed87fa1dcd97d2381e2235c6e43 Jul 09 15:37:44.507569 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:44.507536 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-n599v" event={"ID":"f5f5a3a0-098d-481f-8c22-e2656ab17d31","Type":"ContainerStarted","Data":"ce419823ae599393c7040d9f6fbe077948f3fed87fa1dcd97d2381e2235c6e43"} Jul 09 15:37:47.525405 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:47.525372 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-keda/keda-operator-68bff59c-n599v" event={"ID":"f5f5a3a0-098d-481f-8c22-e2656ab17d31","Type":"ContainerStarted","Data":"357d78a759ecbe359fce8769e1b4ed65b73b1d3e5284727d5dfc2cdc5b05f96f"} Jul 09 15:37:47.525788 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:47.525484 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:37:47.544419 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:37:47.544366 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-keda/keda-operator-68bff59c-n599v" podStartSLOduration=2.215923479 podStartE2EDuration="5.544348099s" totalImagesPullingTime="3.32842462s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:37:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:37:47.542957335 +0000 UTC m=+690.258234876" watchObservedRunningTime="2026-07-09 15:37:47.544348099 +0000 UTC m=+690.259625615" Jul 09 15:38:01.535883 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.535817 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7d8976c599-fxbhm" podUID="daddd0a2-3d9e-4909-940c-3f1074417a34" containerName="console" containerID="cri-o://d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f" gracePeriod=15 Jul 09 15:38:01.815311 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.815283 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:38:01.878819 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878784 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.878819 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878821 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878849 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878881 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878924 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879060 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.878946 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879248 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879070 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbqm8\" (UniqueName: \"kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8\") pod \"daddd0a2-3d9e-4909-940c-3f1074417a34\" (UID: \"daddd0a2-3d9e-4909-940c-3f1074417a34\") " Jul 09 15:38:01.879307 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879249 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca" (OuterVolumeSpecName: "service-ca") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:38:01.879437 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879414 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:38:01.879548 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879525 2581 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-service-ca\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.879600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879558 2581 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-oauth-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.879600 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879563 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config" (OuterVolumeSpecName: "console-config") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:38:01.879683 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.879664 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 15:38:01.881452 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.881399 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:38:01.881452 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.881426 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:38:01.881452 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.881437 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8" (OuterVolumeSpecName: "kube-api-access-kbqm8") pod "daddd0a2-3d9e-4909-940c-3f1074417a34" (UID: "daddd0a2-3d9e-4909-940c-3f1074417a34"). InnerVolumeSpecName "kube-api-access-kbqm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:38:01.980671 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.980628 2581 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-console-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.980671 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.980662 2581 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-serving-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.980671 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.980672 2581 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/daddd0a2-3d9e-4909-940c-3f1074417a34-trusted-ca-bundle\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.980671 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.980681 2581 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/daddd0a2-3d9e-4909-940c-3f1074417a34-console-oauth-config\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:01.980934 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:01.980712 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbqm8\" (UniqueName: \"kubernetes.io/projected/daddd0a2-3d9e-4909-940c-3f1074417a34-kube-api-access-kbqm8\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:38:02.593316 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.593281 2581 generic.go:356] "Generic (PLEG): container finished" podID="daddd0a2-3d9e-4909-940c-3f1074417a34" containerID="d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f" exitCode=0 Jul 09 15:38:02.593744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.593336 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8976c599-fxbhm" event={"ID":"daddd0a2-3d9e-4909-940c-3f1074417a34","Type":"ContainerDied","Data":"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f"} Jul 09 15:38:02.593744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.593396 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8976c599-fxbhm" event={"ID":"daddd0a2-3d9e-4909-940c-3f1074417a34","Type":"ContainerDied","Data":"66495474abff5f50455b5729822605cd191579ab8ef47fba84b8af1d4998f83a"} Jul 09 15:38:02.593744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.593338 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8976c599-fxbhm" Jul 09 15:38:02.593744 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.593416 2581 scope.go:117] "RemoveContainer" containerID="d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f" Jul 09 15:38:02.602654 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.602637 2581 scope.go:117] "RemoveContainer" containerID="d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f" Jul 09 15:38:02.602940 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:38:02.602922 2581 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f\": container with ID starting with d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f not found: ID does not exist" containerID="d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f" Jul 09 15:38:02.603009 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.602947 2581 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f"} err="failed to get container status \"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f\": rpc error: code = NotFound desc = could not find container \"d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f\": container with ID starting with d5d3babc97b86687b87b3afe0d4bb73635b882f3b5ceebb7da24b97e8bf3451f not found: ID does not exist" Jul 09 15:38:02.618099 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.618070 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:38:02.619699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:02.619674 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8976c599-fxbhm"] Jul 09 15:38:03.505952 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:03.505923 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/custom-metrics-autoscaler-operator-75f7c5f8f-ml79g" Jul 09 15:38:03.813340 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:03.813262 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="daddd0a2-3d9e-4909-940c-3f1074417a34" path="/var/lib/kubelet/pods/daddd0a2-3d9e-4909-940c-3f1074417a34/volumes" Jul 09 15:38:08.533270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:08.533191 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-keda/keda-operator-68bff59c-n599v" Jul 09 15:38:51.680808 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.680776 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:38:51.681250 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.681151 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="daddd0a2-3d9e-4909-940c-3f1074417a34" containerName="console" Jul 09 15:38:51.681250 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.681164 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="daddd0a2-3d9e-4909-940c-3f1074417a34" containerName="console" Jul 09 15:38:51.681250 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.681236 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="daddd0a2-3d9e-4909-940c-3f1074417a34" containerName="console" Jul 09 15:38:51.683271 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.683255 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.685973 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.685951 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-webhook-server-cert\"" Jul 09 15:38:51.686109 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.685993 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"openshift-service-ca.crt\"" Jul 09 15:38:51.686109 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.686057 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"kserve-controller-manager-dockercfg-vxpbk\"" Jul 09 15:38:51.686109 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.686064 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kserve\"/\"kube-root-ca.crt\"" Jul 09 15:38:51.695013 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.694991 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:38:51.720309 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.720272 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/seaweedfs-64568bcd49-ws6cb"] Jul 09 15:38:51.723034 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.723011 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.725418 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.725398 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"default-dockercfg-7tdh8\"" Jul 09 15:38:51.725418 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.725414 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kserve\"/\"mlpipeline-s3-artifact\"" Jul 09 15:38:51.733666 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.733633 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-ws6cb"] Jul 09 15:38:51.776593 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.776560 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d438dd2-761b-42c4-8198-626e47577a11-data\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.776764 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.776616 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhrd5\" (UniqueName: \"kubernetes.io/projected/1d438dd2-761b-42c4-8198-626e47577a11-kube-api-access-jhrd5\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.877954 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.877918 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d438dd2-761b-42c4-8198-626e47577a11-data\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.877954 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.877957 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.878213 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.878009 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhrd5\" (UniqueName: \"kubernetes.io/projected/1d438dd2-761b-42c4-8198-626e47577a11-kube-api-access-jhrd5\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.878213 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.878027 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prf4p\" (UniqueName: \"kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.878389 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.878360 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/1d438dd2-761b-42c4-8198-626e47577a11-data\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.887237 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.887202 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhrd5\" (UniqueName: \"kubernetes.io/projected/1d438dd2-761b-42c4-8198-626e47577a11-kube-api-access-jhrd5\") pod \"seaweedfs-64568bcd49-ws6cb\" (UID: \"1d438dd2-761b-42c4-8198-626e47577a11\") " pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:51.978560 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.978451 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.978560 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.978531 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prf4p\" (UniqueName: \"kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.981132 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.981105 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.987591 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.987554 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prf4p\" (UniqueName: \"kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p\") pod \"kserve-controller-manager-799c68cd74-vf5nc\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:51.994222 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:51.994199 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:52.034041 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:52.034005 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:52.142750 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:52.142720 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:38:52.145419 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:38:52.145393 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf5fd84c_27c6_4dbd_a748_7888b404f8be.slice/crio-40d3ce01850cf85254f93d415c3949ecdaf0d12959fdf1e419bf2199ba627fb2 WatchSource:0}: Error finding container 40d3ce01850cf85254f93d415c3949ecdaf0d12959fdf1e419bf2199ba627fb2: Status 404 returned error can't find the container with id 40d3ce01850cf85254f93d415c3949ecdaf0d12959fdf1e419bf2199ba627fb2 Jul 09 15:38:52.181002 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:52.180976 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/seaweedfs-64568bcd49-ws6cb"] Jul 09 15:38:52.183604 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:38:52.183573 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d438dd2_761b_42c4_8198_626e47577a11.slice/crio-bbd8d7fe52e1293eb0e5edc64e0cca33dc6265c1c2cb7bf87584a48d1befe425 WatchSource:0}: Error finding container bbd8d7fe52e1293eb0e5edc64e0cca33dc6265c1c2cb7bf87584a48d1befe425: Status 404 returned error can't find the container with id bbd8d7fe52e1293eb0e5edc64e0cca33dc6265c1c2cb7bf87584a48d1befe425 Jul 09 15:38:52.820824 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:52.820738 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-ws6cb" event={"ID":"1d438dd2-761b-42c4-8198-626e47577a11","Type":"ContainerStarted","Data":"bbd8d7fe52e1293eb0e5edc64e0cca33dc6265c1c2cb7bf87584a48d1befe425"} Jul 09 15:38:52.822997 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:52.822938 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" event={"ID":"df5fd84c-27c6-4dbd-a748-7888b404f8be","Type":"ContainerStarted","Data":"40d3ce01850cf85254f93d415c3949ecdaf0d12959fdf1e419bf2199ba627fb2"} Jul 09 15:38:56.843801 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.843764 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/seaweedfs-64568bcd49-ws6cb" event={"ID":"1d438dd2-761b-42c4-8198-626e47577a11","Type":"ContainerStarted","Data":"c01160edb066d23357b2289485cf54844e68a69b7e5bbac814d5fd3e51d76747"} Jul 09 15:38:56.844265 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.843876 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:38:56.845320 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.845299 2581 generic.go:356] "Generic (PLEG): container finished" podID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerID="77b48bfa1578f44e8417ced3538ecb362051722c813bd28fd45de3083f16d618" exitCode=1 Jul 09 15:38:56.845391 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.845377 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" event={"ID":"df5fd84c-27c6-4dbd-a748-7888b404f8be","Type":"ContainerDied","Data":"77b48bfa1578f44e8417ced3538ecb362051722c813bd28fd45de3083f16d618"} Jul 09 15:38:56.845555 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.845540 2581 scope.go:117] "RemoveContainer" containerID="77b48bfa1578f44e8417ced3538ecb362051722c813bd28fd45de3083f16d618" Jul 09 15:38:56.860340 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.860291 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/seaweedfs-64568bcd49-ws6cb" podStartSLOduration=2.139150478 podStartE2EDuration="5.860274395s" totalImagesPullingTime="3.721123917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:38:56.859469125 +0000 UTC m=+759.574746643" watchObservedRunningTime="2026-07-09 15:38:56.860274395 +0000 UTC m=+759.575551911" Jul 09 15:38:56.994406 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:56.994362 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:38:57.852813 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:57.852779 2581 generic.go:356] "Generic (PLEG): container finished" podID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" exitCode=1 Jul 09 15:38:57.853277 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:57.852869 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" event={"ID":"df5fd84c-27c6-4dbd-a748-7888b404f8be","Type":"ContainerDied","Data":"67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339"} Jul 09 15:38:57.853277 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:57.852927 2581 scope.go:117] "RemoveContainer" containerID="77b48bfa1578f44e8417ced3538ecb362051722c813bd28fd45de3083f16d618" Jul 09 15:38:57.853277 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:57.853137 2581 scope.go:117] "RemoveContainer" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" Jul 09 15:38:57.853430 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:38:57.853370 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-vf5nc_kserve(df5fd84c-27c6-4dbd-a748-7888b404f8be)\"" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" Jul 09 15:38:58.859889 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:38:58.859853 2581 scope.go:117] "RemoveContainer" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" Jul 09 15:38:58.860316 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:38:58.860093 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-vf5nc_kserve(df5fd84c-27c6-4dbd-a748-7888b404f8be)\"" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" Jul 09 15:39:01.994619 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:01.994576 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:01.995010 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:01.994642 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:01.995010 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:01.994949 2581 scope.go:117] "RemoveContainer" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" Jul 09 15:39:01.995128 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:01.995108 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-vf5nc_kserve(df5fd84c-27c6-4dbd-a748-7888b404f8be)\"" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" Jul 09 15:39:02.855642 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:02.855610 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kserve/seaweedfs-64568bcd49-ws6cb" Jul 09 15:39:17.810458 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:17.810420 2581 scope.go:117] "RemoveContainer" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" Jul 09 15:39:18.957199 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:18.957171 2581 generic.go:356] "Generic (PLEG): container finished" podID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerID="291ba120676510eb0b808f5857f49030f9c2baac2799ce26b342448e2954868c" exitCode=1 Jul 09 15:39:18.957691 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:18.957246 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" event={"ID":"df5fd84c-27c6-4dbd-a748-7888b404f8be","Type":"ContainerDied","Data":"291ba120676510eb0b808f5857f49030f9c2baac2799ce26b342448e2954868c"} Jul 09 15:39:18.957691 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:18.957315 2581 scope.go:117] "RemoveContainer" containerID="67eaa1ddd32dce84b9eb729c5082e583aabe33c44f6e4cf3dbc38b7434448339" Jul 09 15:39:18.957805 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:18.957726 2581 scope.go:117] "RemoveContainer" containerID="291ba120676510eb0b808f5857f49030f9c2baac2799ce26b342448e2954868c" Jul 09 15:39:18.957920 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:18.957902 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-vf5nc_kserve(df5fd84c-27c6-4dbd-a748-7888b404f8be)\"" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" Jul 09 15:39:21.995369 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:21.995308 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:21.995369 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:21.995388 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:21.995873 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:21.995707 2581 scope.go:117] "RemoveContainer" containerID="291ba120676510eb0b808f5857f49030f9c2baac2799ce26b342448e2954868c" Jul 09 15:39:21.995908 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:21.995884 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-vf5nc_kserve(df5fd84c-27c6-4dbd-a748-7888b404f8be)\"" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" Jul 09 15:39:26.948850 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:26.948815 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:39:26.973068 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:26.973034 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-r45fh"] Jul 09 15:39:26.977805 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:26.977768 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:26.986455 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:26.986423 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-r45fh"] Jul 09 15:39:27.083616 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.083587 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9qhb6\" (UniqueName: \"kubernetes.io/projected/2129a93f-1805-4f00-a201-0ec294fb998f-kube-api-access-9qhb6\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.083746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.083641 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2129a93f-1805-4f00-a201-0ec294fb998f-cert\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.089879 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.089859 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:27.184699 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.184658 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert\") pod \"df5fd84c-27c6-4dbd-a748-7888b404f8be\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " Jul 09 15:39:27.184879 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.184746 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-prf4p\" (UniqueName: \"kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p\") pod \"df5fd84c-27c6-4dbd-a748-7888b404f8be\" (UID: \"df5fd84c-27c6-4dbd-a748-7888b404f8be\") " Jul 09 15:39:27.184933 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.184908 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9qhb6\" (UniqueName: \"kubernetes.io/projected/2129a93f-1805-4f00-a201-0ec294fb998f-kube-api-access-9qhb6\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.184973 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.184944 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2129a93f-1805-4f00-a201-0ec294fb998f-cert\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.187022 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.186988 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p" (OuterVolumeSpecName: "kube-api-access-prf4p") pod "df5fd84c-27c6-4dbd-a748-7888b404f8be" (UID: "df5fd84c-27c6-4dbd-a748-7888b404f8be"). InnerVolumeSpecName "kube-api-access-prf4p". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:39:27.187022 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.187004 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert" (OuterVolumeSpecName: "cert") pod "df5fd84c-27c6-4dbd-a748-7888b404f8be" (UID: "df5fd84c-27c6-4dbd-a748-7888b404f8be"). InnerVolumeSpecName "cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 15:39:27.187229 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.187211 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2129a93f-1805-4f00-a201-0ec294fb998f-cert\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.193637 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.193612 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9qhb6\" (UniqueName: \"kubernetes.io/projected/2129a93f-1805-4f00-a201-0ec294fb998f-kube-api-access-9qhb6\") pod \"kserve-controller-manager-799c68cd74-r45fh\" (UID: \"2129a93f-1805-4f00-a201-0ec294fb998f\") " pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.286089 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.285999 2581 reconciler_common.go:299] "Volume detached for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df5fd84c-27c6-4dbd-a748-7888b404f8be-cert\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:39:27.286089 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.286032 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-prf4p\" (UniqueName: \"kubernetes.io/projected/df5fd84c-27c6-4dbd-a748-7888b404f8be-kube-api-access-prf4p\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:39:27.288923 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.288901 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:27.425790 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:27.422326 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-r45fh"] Jul 09 15:39:28.001270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.001240 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" Jul 09 15:39:28.001768 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.001239 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-vf5nc" event={"ID":"df5fd84c-27c6-4dbd-a748-7888b404f8be","Type":"ContainerDied","Data":"40d3ce01850cf85254f93d415c3949ecdaf0d12959fdf1e419bf2199ba627fb2"} Jul 09 15:39:28.001768 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.001400 2581 scope.go:117] "RemoveContainer" containerID="291ba120676510eb0b808f5857f49030f9c2baac2799ce26b342448e2954868c" Jul 09 15:39:28.006076 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.006038 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerStarted","Data":"5a8e775dbe1697c6ff7918e321fc4c0ac05d9e5665477c2ce5f18271e380279a"} Jul 09 15:39:28.019520 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.019482 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:39:28.023328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:28.023305 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kserve/kserve-controller-manager-799c68cd74-vf5nc"] Jul 09 15:39:29.012884 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:29.012849 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="3ca4de2b5fd97944e7b0f00a1df52e83b082290ff4bfaceba2b25214e7a2246e" exitCode=1 Jul 09 15:39:29.013395 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:29.012920 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"3ca4de2b5fd97944e7b0f00a1df52e83b082290ff4bfaceba2b25214e7a2246e"} Jul 09 15:39:29.013395 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:29.013087 2581 scope.go:117] "RemoveContainer" containerID="3ca4de2b5fd97944e7b0f00a1df52e83b082290ff4bfaceba2b25214e7a2246e" Jul 09 15:39:29.812990 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:29.812893 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" path="/var/lib/kubelet/pods/df5fd84c-27c6-4dbd-a748-7888b404f8be/volumes" Jul 09 15:39:30.019094 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:30.019058 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" exitCode=1 Jul 09 15:39:30.019549 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:30.019144 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9"} Jul 09 15:39:30.019549 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:30.019192 2581 scope.go:117] "RemoveContainer" containerID="3ca4de2b5fd97944e7b0f00a1df52e83b082290ff4bfaceba2b25214e7a2246e" Jul 09 15:39:30.019549 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:30.019442 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:30.019720 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:30.019691 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:39:31.025659 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:31.025634 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:31.026025 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:31.025801 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:39:32.289616 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:32.289565 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:32.290032 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:32.289942 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:32.290143 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:32.290124 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:39:37.289890 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:37.289843 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:37.290285 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:37.290194 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:37.290397 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:37.290364 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:39:51.807859 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:51.807770 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:53.136266 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:53.136233 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" exitCode=1 Jul 09 15:39:53.136679 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:53.136303 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3"} Jul 09 15:39:53.136679 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:53.136366 2581 scope.go:117] "RemoveContainer" containerID="2d826dc8a52a30a773bc810b17f5a2920d55b098aec423674d72cf7b8fab6cc9" Jul 09 15:39:53.136801 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:53.136754 2581 scope.go:117] "RemoveContainer" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" Jul 09 15:39:53.136964 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:53.136945 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:39:57.289392 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:57.289353 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:57.289916 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:57.289453 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:39:57.289916 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:39:57.289889 2581 scope.go:117] "RemoveContainer" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" Jul 09 15:39:57.290152 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:39:57.290125 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:07.809627 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:07.809598 2581 scope.go:117] "RemoveContainer" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" Jul 09 15:40:07.810116 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:07.809771 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:22.808098 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:22.808066 2581 scope.go:117] "RemoveContainer" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" Jul 09 15:40:23.280069 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:23.279998 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerStarted","Data":"38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e"} Jul 09 15:40:23.280321 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:23.280250 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:40:23.312293 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:23.312243 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podStartSLOduration=55.314548948 podStartE2EDuration="57.312225683s" totalImagesPullingTime="1.997676735s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:39:26 +0000 UTC" imagePullSessionsCount=4 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:40:23.309004437 +0000 UTC m=+846.024281956" watchObservedRunningTime="2026-07-09 15:40:23.312225683 +0000 UTC m=+846.027503199" Jul 09 15:40:24.286303 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:24.286270 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" exitCode=1 Jul 09 15:40:24.286717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:24.286370 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e"} Jul 09 15:40:24.286717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:24.286426 2581 scope.go:117] "RemoveContainer" containerID="a647601941acc9e96733ed852bc31e6eea6e8e2afeb2fba43a6f6f35c4836ab3" Jul 09 15:40:24.286717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:24.286591 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:40:24.286843 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:24.286803 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:25.292345 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:25.292317 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:40:25.292762 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:25.292528 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:27.289705 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:27.289665 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:40:27.290108 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:27.290061 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:40:27.290254 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:27.290236 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:40.808353 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:40.808321 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:40:40.808895 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:40.808521 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:40:53.807837 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:40:53.807805 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:40:53.808213 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:40:53.807999 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:04.808367 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:04.808335 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:41:05.479691 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:05.479658 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" exitCode=1 Jul 09 15:41:05.479841 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:05.479735 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b"} Jul 09 15:41:05.479841 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:05.479798 2581 scope.go:117] "RemoveContainer" containerID="38c81fe3c15d2db295d77d9cc27a0324ef581512bf1080d5e48c4d7f39c1d69e" Jul 09 15:41:05.480174 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:05.480151 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:05.480392 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:05.480371 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:07.290042 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:07.289997 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:41:07.290534 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:07.290466 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:07.290692 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:07.290670 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:08.281010 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:08.280888 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:41:08.281299 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:08.281285 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:08.281474 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:08.281457 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:17.766969 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:17.766935 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:41:17.766969 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:17.766974 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:41:20.808289 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:20.808254 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:20.808674 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:20.808443 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:35.807639 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:35.807600 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:35.808233 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:35.807859 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:41:50.807995 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:41:50.807957 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:41:50.808590 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:41:50.808201 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:03.807760 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:03.807727 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:42:03.808202 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:03.807888 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:17.809635 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:17.809609 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:42:17.811772 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:17.809810 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 1m20s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:30.808206 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:30.808172 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:42:30.808787 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:30.808607 2581 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 15:42:31.881662 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:31.881629 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" exitCode=1 Jul 09 15:42:31.882043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:31.881683 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd"} Jul 09 15:42:31.882043 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:31.881743 2581 scope.go:117] "RemoveContainer" containerID="419e5801bbcb4fb6f6e630c3afa39bd75dcaac524c54d41ca919247bc3ef5d5b" Jul 09 15:42:31.882182 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:31.882066 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:42:31.882278 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:31.882258 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:33.280371 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:33.280320 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:42:33.280835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:33.280738 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:42:33.280919 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:33.280901 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:37.289304 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:37.289264 2581 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" Jul 09 15:42:37.289733 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:37.289681 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:42:37.289866 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:37.289846 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:42:51.807835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:42:51.807752 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:42:51.808210 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:42:51.808003 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:43:06.807935 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:43:06.807902 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:43:06.808380 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:43:06.808095 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:43:20.807682 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:43:20.807647 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:43:20.808063 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:43:20.807834 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:43:35.808390 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:43:35.808356 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:43:35.808822 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:43:35.808637 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:43:48.807803 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:43:48.807769 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:43:48.808259 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:43:48.807974 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:02.807717 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:02.807685 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:44:02.808095 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:02.807893 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:16.808598 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:16.808477 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:44:16.809019 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:16.808661 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:27.809913 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:27.809882 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:44:27.810468 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:27.810047 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:32.228246 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228203 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-89sdh/must-gather-g75rl"] Jul 09 15:44:32.228648 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228585 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228648 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228595 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228648 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228617 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228648 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228623 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228769 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228671 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228769 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228679 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228769 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228687 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228769 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228744 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.228769 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.228749 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="df5fd84c-27c6-4dbd-a748-7888b404f8be" containerName="manager" Jul 09 15:44:32.231922 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.231898 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.234413 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.234387 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89sdh\"/\"kube-root-ca.crt\"" Jul 09 15:44:32.234544 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.234401 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-89sdh\"/\"openshift-service-ca.crt\"" Jul 09 15:44:32.235456 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.235431 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-89sdh\"/\"default-dockercfg-jt6cf\"" Jul 09 15:44:32.257003 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.256972 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89sdh/must-gather-g75rl"] Jul 09 15:44:32.296385 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.296343 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.296385 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.296381 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vw7nx\" (UniqueName: \"kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.397107 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.397072 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.397107 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.397107 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vw7nx\" (UniqueName: \"kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.397430 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.397410 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.408704 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.408673 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vw7nx\" (UniqueName: \"kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx\") pod \"must-gather-g75rl\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.553302 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.553218 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:32.690691 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:32.690659 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-89sdh/must-gather-g75rl"] Jul 09 15:44:32.694176 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:44:32.694146 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcb695d54_e189_436c_a357_51a45ed796d5.slice/crio-6759901c16a0e0019e977fe9e1ccbdda5187e7ec3aafb2b00f61e2fb92f32481 WatchSource:0}: Error finding container 6759901c16a0e0019e977fe9e1ccbdda5187e7ec3aafb2b00f61e2fb92f32481: Status 404 returned error can't find the container with id 6759901c16a0e0019e977fe9e1ccbdda5187e7ec3aafb2b00f61e2fb92f32481 Jul 09 15:44:33.461016 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:33.460949 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89sdh/must-gather-g75rl" event={"ID":"cb695d54-e189-436c-a357-51a45ed796d5","Type":"ContainerStarted","Data":"6759901c16a0e0019e977fe9e1ccbdda5187e7ec3aafb2b00f61e2fb92f32481"} Jul 09 15:44:38.808446 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:38.808411 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:44:38.808920 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:38.808678 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:39.494129 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:39.494092 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89sdh/must-gather-g75rl" event={"ID":"cb695d54-e189-436c-a357-51a45ed796d5","Type":"ContainerStarted","Data":"c998672fdc733b944704f3b8bbaa76c6ebc0cc1bb0a3cb654598bba652ddc5d1"} Jul 09 15:44:39.494336 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:39.494142 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89sdh/must-gather-g75rl" event={"ID":"cb695d54-e189-436c-a357-51a45ed796d5","Type":"ContainerStarted","Data":"f1995f5e4b3588bef4429e4fb7e212b732f811fc0e537c6ab86c87faac2aeeaf"} Jul 09 15:44:39.511946 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:39.511881 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-89sdh/must-gather-g75rl" podStartSLOduration=1.267739773 podStartE2EDuration="7.511863575s" totalImagesPullingTime="6.244123802s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 15:44:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:44:39.510234085 +0000 UTC m=+1102.225511601" watchObservedRunningTime="2026-07-09 15:44:39.511863575 +0000 UTC m=+1102.227141139" Jul 09 15:44:51.807945 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:51.807909 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:44:51.808613 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:51.808174 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:44:52.562172 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:52.562139 2581 generic.go:356] "Generic (PLEG): container finished" podID="cb695d54-e189-436c-a357-51a45ed796d5" containerID="f1995f5e4b3588bef4429e4fb7e212b732f811fc0e537c6ab86c87faac2aeeaf" exitCode=0 Jul 09 15:44:52.562408 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:52.562221 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-89sdh/must-gather-g75rl" event={"ID":"cb695d54-e189-436c-a357-51a45ed796d5","Type":"ContainerDied","Data":"f1995f5e4b3588bef4429e4fb7e212b732f811fc0e537c6ab86c87faac2aeeaf"} Jul 09 15:44:52.562645 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:52.562628 2581 scope.go:117] "RemoveContainer" containerID="f1995f5e4b3588bef4429e4fb7e212b732f811fc0e537c6ab86c87faac2aeeaf" Jul 09 15:44:53.040270 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:53.040223 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-89sdh_must-gather-g75rl_cb695d54-e189-436c-a357-51a45ed796d5/gather/0.log" Jul 09 15:44:56.222748 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:56.222716 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-fxxwc_4c1e25b4-7f2d-48a1-a298-15ac34b188d4/global-pull-secret-syncer/0.log" Jul 09 15:44:56.391655 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:56.391626 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hzct9_1899388c-7f31-4ebd-b4bd-2e2fc6137872/konnectivity-agent/0.log" Jul 09 15:44:56.471415 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:56.471377 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-130-22.ec2.internal_5194c3f0f86f0f687ce0565b6dadc74e/haproxy/0.log" Jul 09 15:44:58.364379 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.364342 2581 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-89sdh/must-gather-g75rl"] Jul 09 15:44:58.364836 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.364557 2581 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-89sdh/must-gather-g75rl" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="copy" containerID="cri-o://c998672fdc733b944704f3b8bbaa76c6ebc0cc1bb0a3cb654598bba652ddc5d1" gracePeriod=2 Jul 09 15:44:58.369337 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.369311 2581 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-89sdh/must-gather-g75rl"] Jul 09 15:44:58.593249 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.593226 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-89sdh_must-gather-g75rl_cb695d54-e189-436c-a357-51a45ed796d5/copy/0.log" Jul 09 15:44:58.593597 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.593576 2581 generic.go:356] "Generic (PLEG): container finished" podID="cb695d54-e189-436c-a357-51a45ed796d5" containerID="c998672fdc733b944704f3b8bbaa76c6ebc0cc1bb0a3cb654598bba652ddc5d1" exitCode=143 Jul 09 15:44:58.593668 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.593637 2581 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6759901c16a0e0019e977fe9e1ccbdda5187e7ec3aafb2b00f61e2fb92f32481" Jul 09 15:44:58.599309 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.599290 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-89sdh_must-gather-g75rl_cb695d54-e189-436c-a357-51a45ed796d5/copy/0.log" Jul 09 15:44:58.600835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.600816 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:58.603332 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:58.603301 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g75rl\" is forbidden: User \"system:node:ip-10-0-130-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-89sdh\": no relationship found between node 'ip-10-0-130-22.ec2.internal' and this object" podUID="cb695d54-e189-436c-a357-51a45ed796d5" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:58.733153 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.733115 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output\") pod \"cb695d54-e189-436c-a357-51a45ed796d5\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " Jul 09 15:44:58.733337 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.733203 2581 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vw7nx\" (UniqueName: \"kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx\") pod \"cb695d54-e189-436c-a357-51a45ed796d5\" (UID: \"cb695d54-e189-436c-a357-51a45ed796d5\") " Jul 09 15:44:58.733625 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.733600 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "cb695d54-e189-436c-a357-51a45ed796d5" (UID: "cb695d54-e189-436c-a357-51a45ed796d5"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 15:44:58.735585 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.735559 2581 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx" (OuterVolumeSpecName: "kube-api-access-vw7nx") pod "cb695d54-e189-436c-a357-51a45ed796d5" (UID: "cb695d54-e189-436c-a357-51a45ed796d5"). InnerVolumeSpecName "kube-api-access-vw7nx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 15:44:58.834762 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.834727 2581 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vw7nx\" (UniqueName: \"kubernetes.io/projected/cb695d54-e189-436c-a357-51a45ed796d5-kube-api-access-vw7nx\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:44:58.834762 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:58.834757 2581 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/cb695d54-e189-436c-a357-51a45ed796d5-must-gather-output\") on node \"ip-10-0-130-22.ec2.internal\" DevicePath \"\"" Jul 09 15:44:59.598470 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:59.598437 2581 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:59.603010 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:59.602980 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g75rl\" is forbidden: User \"system:node:ip-10-0-130-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-89sdh\": no relationship found between node 'ip-10-0-130-22.ec2.internal' and this object" podUID="cb695d54-e189-436c-a357-51a45ed796d5" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:59.609995 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:44:59.609969 2581 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-g75rl\" is forbidden: User \"system:node:ip-10-0-130-22.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-89sdh\": no relationship found between node 'ip-10-0-130-22.ec2.internal' and this object" podUID="cb695d54-e189-436c-a357-51a45ed796d5" pod="openshift-must-gather-89sdh/must-gather-g75rl" Jul 09 15:44:59.813601 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:44:59.813572 2581 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cb695d54-e189-436c-a357-51a45ed796d5" path="/var/lib/kubelet/pods/cb695d54-e189-436c-a357-51a45ed796d5/volumes" Jul 09 15:45:00.621022 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.620993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/alertmanager/0.log" Jul 09 15:45:00.650620 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.650586 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/config-reloader/0.log" Jul 09 15:45:00.682993 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.682966 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/kube-rbac-proxy-web/0.log" Jul 09 15:45:00.708990 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.708952 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/kube-rbac-proxy/0.log" Jul 09 15:45:00.733889 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.733853 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/kube-rbac-proxy-metric/0.log" Jul 09 15:45:00.764192 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.764164 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/prom-label-proxy/0.log" Jul 09 15:45:00.795280 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.795251 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_9ac9bd98-0251-4de5-b09b-13005fbda71a/init-config-reloader/0.log" Jul 09 15:45:00.842983 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:00.842954 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-49k82_0850d09b-0ec7-4f07-9a79-44a7c9fd91bf/cluster-monitoring-operator/0.log" Jul 09 15:45:01.063618 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:01.063584 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-d4g6s_02645cee-27a3-4861-8bf8-17be8501c3df/monitoring-plugin/0.log" Jul 09 15:45:01.118947 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:01.118918 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/node-exporter/0.log" Jul 09 15:45:01.153861 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:01.153836 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/kube-rbac-proxy/0.log" Jul 09 15:45:01.190368 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:01.190337 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-577cb_54e8cc13-fcd1-4040-92fa-71638d23e85f/init-textfile/0.log" Jul 09 15:45:02.045791 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.045755 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jntt6_3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de/prometheus-operator/0.log" Jul 09 15:45:02.103127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.103095 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-jntt6_3b92b89a-c8fe-4c5b-a0ea-8b7f3e8555de/kube-rbac-proxy/0.log" Jul 09 15:45:02.202187 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.202163 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-hrz5q_69f18f41-7f94-47a7-a3d8-8c36b57c8f0e/prometheus-operator-admission-webhook/0.log" Jul 09 15:45:02.254421 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.254383 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79fb87d797-6zh59_03162a46-3b08-4a29-90ff-572ea8787348/telemeter-client/0.log" Jul 09 15:45:02.306239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.306154 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79fb87d797-6zh59_03162a46-3b08-4a29-90ff-572ea8787348/reload/0.log" Jul 09 15:45:02.355121 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.355090 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-79fb87d797-6zh59_03162a46-3b08-4a29-90ff-572ea8787348/kube-rbac-proxy/0.log" Jul 09 15:45:02.390660 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.390632 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/thanos-query/0.log" Jul 09 15:45:02.430357 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.430327 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-web/0.log" Jul 09 15:45:02.462830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.462793 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy/0.log" Jul 09 15:45:02.502538 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.502507 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/prom-label-proxy/0.log" Jul 09 15:45:02.538340 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.538310 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-rules/0.log" Jul 09 15:45:02.568760 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:02.568680 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-546d7d69f6-npqx9_dbdf8304-b510-447e-8cd5-294332fa63fa/kube-rbac-proxy-metrics/0.log" Jul 09 15:45:03.641292 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:03.641255 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-jzvsg_9fbd13fb-b417-4bd6-b85d-4b77de35e68c/networking-console-plugin/0.log" Jul 09 15:45:04.165863 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.165830 2581 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b"] Jul 09 15:45:04.166195 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166184 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="gather" Jul 09 15:45:04.166239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166197 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="gather" Jul 09 15:45:04.166239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166218 2581 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="copy" Jul 09 15:45:04.166239 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166225 2581 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="copy" Jul 09 15:45:04.166329 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166275 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="gather" Jul 09 15:45:04.166329 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.166288 2581 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb695d54-e189-436c-a357-51a45ed796d5" containerName="copy" Jul 09 15:45:04.168959 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.168934 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.171658 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.171630 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88bmh\"/\"openshift-service-ca.crt\"" Jul 09 15:45:04.172683 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.172668 2581 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-88bmh\"/\"kube-root-ca.crt\"" Jul 09 15:45:04.172783 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.172672 2581 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-88bmh\"/\"default-dockercfg-82rxv\"" Jul 09 15:45:04.179936 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.179912 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b"] Jul 09 15:45:04.286291 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.286247 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-sys\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.286291 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.286294 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-proc\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.286556 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.286314 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-podres\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.286556 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.286329 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c94dn\" (UniqueName: \"kubernetes.io/projected/02b80a66-ca2f-450a-95a6-17e64ef665ac-kube-api-access-c94dn\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.286556 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.286397 2581 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-lib-modules\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387704 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-sys\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387746 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387748 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-proc\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387767 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-podres\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387832 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c94dn\" (UniqueName: \"kubernetes.io/projected/02b80a66-ca2f-450a-95a6-17e64ef665ac-kube-api-access-c94dn\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-sys\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387845 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-proc\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.387979 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.387896 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-podres\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.388216 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.388059 2581 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-lib-modules\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.388216 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.388187 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/02b80a66-ca2f-450a-95a6-17e64ef665ac-lib-modules\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.398427 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.398398 2581 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c94dn\" (UniqueName: \"kubernetes.io/projected/02b80a66-ca2f-450a-95a6-17e64ef665ac-kube-api-access-c94dn\") pod \"perf-node-gather-daemonset-f882b\" (UID: \"02b80a66-ca2f-450a-95a6-17e64ef665ac\") " pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.481019 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.480924 2581 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:04.631120 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.631099 2581 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b"] Jul 09 15:45:04.633473 ip-10-0-130-22 kubenswrapper[2581]: W0709 15:45:04.633437 2581 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod02b80a66_ca2f_450a_95a6_17e64ef665ac.slice/crio-e475f6cef56669bd77c31216d85bf3d0c9015ef852e16b0efb1f6a0ee01a63b8 WatchSource:0}: Error finding container e475f6cef56669bd77c31216d85bf3d0c9015ef852e16b0efb1f6a0ee01a63b8: Status 404 returned error can't find the container with id e475f6cef56669bd77c31216d85bf3d0c9015ef852e16b0efb1f6a0ee01a63b8 Jul 09 15:45:04.671057 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.671029 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6849bd8dff-rpkj5_fcfa57d5-a79d-43ce-90d1-efff318ff1e6/console/0.log" Jul 09 15:45:04.709874 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:04.709837 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-hxh8v_cec78051-a31e-4985-b7ca-5c5413b3a9c0/download-server/0.log" Jul 09 15:45:05.206021 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:05.205993 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-t5bkz_18ad2658-05f6-46c3-ace6-3d746b456705/volume-data-source-validator/0.log" Jul 09 15:45:05.630470 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:05.630380 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" event={"ID":"02b80a66-ca2f-450a-95a6-17e64ef665ac","Type":"ContainerStarted","Data":"efa5383cfc135982d4a6081ff2927e84f69478b07fcd80d8abbcd93f145604f9"} Jul 09 15:45:05.630470 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:05.630440 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" event={"ID":"02b80a66-ca2f-450a-95a6-17e64ef665ac","Type":"ContainerStarted","Data":"e475f6cef56669bd77c31216d85bf3d0c9015ef852e16b0efb1f6a0ee01a63b8"} Jul 09 15:45:05.630678 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:05.630608 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:05.649112 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:05.649052 2581 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" podStartSLOduration=1.649036436 podStartE2EDuration="1.649036436s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 15:45:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 15:45:05.647578882 +0000 UTC m=+1128.362856398" watchObservedRunningTime="2026-07-09 15:45:05.649036436 +0000 UTC m=+1128.364313951" Jul 09 15:45:06.065147 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:06.065114 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7drzr_5c521020-43d2-4ab5-9ecd-52f3df5ee0c4/dns/0.log" Jul 09 15:45:06.086405 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:06.086378 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-7drzr_5c521020-43d2-4ab5-9ecd-52f3df5ee0c4/kube-rbac-proxy/0.log" Jul 09 15:45:06.215005 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:06.214976 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9h98t_ffe1d3d8-2b8a-42e5-bb66-dd873a15c694/dns-node-resolver/0.log" Jul 09 15:45:06.807830 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:06.807799 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:45:06.808057 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:45:06.808030 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 2m40s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f" Jul 09 15:45:06.850127 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:06.850094 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-pzrzd_06421120-f8ab-418a-aaa7-7732cb928eb8/node-ca/0.log" Jul 09 15:45:07.997543 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:07.997514 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-pjmkc_146b723e-c41e-43d6-b087-6f8ec5802f2d/serve-healthcheck-canary/0.log" Jul 09 15:45:08.454552 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:08.454523 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-28hwq_b6c68179-703e-46d8-ac47-95d6f55381bd/kube-rbac-proxy/0.log" Jul 09 15:45:08.499346 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:08.499305 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-28hwq_b6c68179-703e-46d8-ac47-95d6f55381bd/exporter/0.log" Jul 09 15:45:08.569402 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:08.569372 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-28hwq_b6c68179-703e-46d8-ac47-95d6f55381bd/extractor/0.log" Jul 09 15:45:10.840255 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:10.840216 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-r45fh_2129a93f-1805-4f00-a201-0ec294fb998f/manager/5.log" Jul 09 15:45:10.840664 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:10.840258 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_kserve-controller-manager-799c68cd74-r45fh_2129a93f-1805-4f00-a201-0ec294fb998f/manager/5.log" Jul 09 15:45:10.928042 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:10.928008 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/kserve_seaweedfs-64568bcd49-ws6cb_1d438dd2-761b-42c4-8198-626e47577a11/seaweedfs/0.log" Jul 09 15:45:11.644597 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:11.644564 2581 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-88bmh/perf-node-gather-daemonset-f882b" Jul 09 15:45:15.541040 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:15.540944 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bmxqx_6bf83d60-67ec-4d9c-9981-3547a59db57f/migrator/0.log" Jul 09 15:45:15.568399 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:15.568368 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-bmxqx_6bf83d60-67ec-4d9c-9981-3547a59db57f/graceful-termination/0.log" Jul 09 15:45:15.939944 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:15.939911 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jcht6_2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1/kube-storage-version-migrator-operator/1.log" Jul 09 15:45:15.941967 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:15.941937 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-jcht6_2c0b2c8b-5d88-4be5-85a1-25ef7d54d2d1/kube-storage-version-migrator-operator/0.log" Jul 09 15:45:17.063741 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.063706 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-6jmlt_a0f34d8e-300f-42ad-b4b1-6e4a52ddb61e/kube-multus/0.log" Jul 09 15:45:17.098754 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.098728 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/kube-multus-additional-cni-plugins/0.log" Jul 09 15:45:17.124537 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.124511 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/egress-router-binary-copy/0.log" Jul 09 15:45:17.147034 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.147007 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/cni-plugins/0.log" Jul 09 15:45:17.168718 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.168692 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/bond-cni-plugin/0.log" Jul 09 15:45:17.198794 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.198765 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/routeoverride-cni/0.log" Jul 09 15:45:17.222847 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.222820 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/whereabouts-cni-bincopy/0.log" Jul 09 15:45:17.265409 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.265377 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-5jkkd_0967d262-954b-4f7b-950d-aa7c92d0760c/whereabouts-cni/0.log" Jul 09 15:45:17.918766 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.918725 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-985tq_0a43e8b8-053d-462f-b5fd-d1884a6cce39/network-metrics-daemon/0.log" Jul 09 15:45:17.964087 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:17.964059 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-985tq_0a43e8b8-053d-462f-b5fd-d1884a6cce39/kube-rbac-proxy/0.log" Jul 09 15:45:18.808381 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:18.808350 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:45:19.265835 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.265802 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-controller/0.log" Jul 09 15:45:19.292184 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.292151 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/1.log" Jul 09 15:45:19.292184 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.292180 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovn-acl-logging/0.log" Jul 09 15:45:19.325724 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.325691 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/kube-rbac-proxy-node/0.log" Jul 09 15:45:19.352742 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.352713 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/kube-rbac-proxy-ovn-metrics/0.log" Jul 09 15:45:19.376105 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.376076 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/northd/0.log" Jul 09 15:45:19.413905 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.413876 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/nbdb/0.log" Jul 09 15:45:19.442328 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.442297 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/sbdb/0.log" Jul 09 15:45:19.502383 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:19.502335 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-rffnq_b120a32e-2bc2-40d4-a794-cec93901fb13/ovnkube-controller/0.log" Jul 09 15:45:20.517618 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.516040 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-869dcfcdcd-nhqk8_f3d0c335-3175-4e71-9b49-963ca16481cd/check-endpoints/0.log" Jul 09 15:45:20.539539 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.539489 2581 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-mwhms_2552a32d-d543-4f5b-b72d-c2f93c594ce9/network-check-target-container/0.log" Jul 09 15:45:20.705874 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.705786 2581 generic.go:356] "Generic (PLEG): container finished" podID="2129a93f-1805-4f00-a201-0ec294fb998f" containerID="b53c5047c49c8d0c08e843e76aff3caf02a83045cb9daaddebae10d0d955d29f" exitCode=1 Jul 09 15:45:20.705874 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.705854 2581 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" event={"ID":"2129a93f-1805-4f00-a201-0ec294fb998f","Type":"ContainerDied","Data":"b53c5047c49c8d0c08e843e76aff3caf02a83045cb9daaddebae10d0d955d29f"} Jul 09 15:45:20.706061 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.705940 2581 scope.go:117] "RemoveContainer" containerID="f823483afa94aa23d2161b0c67f5ca78fb1a5d0a3b4d6b74ba17c9449f1305fd" Jul 09 15:45:20.706342 ip-10-0-130-22 kubenswrapper[2581]: I0709 15:45:20.706321 2581 scope.go:117] "RemoveContainer" containerID="b53c5047c49c8d0c08e843e76aff3caf02a83045cb9daaddebae10d0d955d29f" Jul 09 15:45:20.706552 ip-10-0-130-22 kubenswrapper[2581]: E0709 15:45:20.706530 2581 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 5m0s restarting failed container=manager pod=kserve-controller-manager-799c68cd74-r45fh_kserve(2129a93f-1805-4f00-a201-0ec294fb998f)\"" pod="kserve/kserve-controller-manager-799c68cd74-r45fh" podUID="2129a93f-1805-4f00-a201-0ec294fb998f"