Jul 28 06:51:47.552479 ip-10-0-138-102 systemd[1]: Starting Kubernetes Kubelet... Jul 28 06:51:47.907810 ip-10-0-138-102 kubenswrapper[2582]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:47.907810 ip-10-0-138-102 kubenswrapper[2582]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 06:51:47.907810 ip-10-0-138-102 kubenswrapper[2582]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:47.907810 ip-10-0-138-102 kubenswrapper[2582]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 06:51:47.907810 ip-10-0-138-102 kubenswrapper[2582]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 06:51:47.908813 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.908726 2582 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 06:51:47.914296 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914281 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.914296 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914295 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914299 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914303 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914313 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914316 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914319 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914321 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914324 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914327 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914329 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914332 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914334 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914337 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914339 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914342 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914345 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914347 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914350 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914352 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914355 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.914367 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914360 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914363 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914365 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914368 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914371 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914374 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914377 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914380 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914383 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914385 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914388 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914390 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914392 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914395 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914397 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914400 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914402 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914404 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914407 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914410 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.914831 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914412 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914415 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914419 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914423 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914427 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914430 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914432 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914435 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914437 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914441 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914443 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914446 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914448 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914451 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914454 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914457 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914459 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914462 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914464 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.915351 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914467 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914469 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914472 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914474 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914477 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914480 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914482 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914485 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914487 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914490 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914493 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914495 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914498 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914501 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914503 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914507 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914509 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914512 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914516 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914520 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.915843 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914523 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914525 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914528 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914531 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914535 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914538 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914542 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914545 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914548 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914551 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914554 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914557 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914559 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914562 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914564 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914566 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914569 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914571 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.914574 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.916335 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915288 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915295 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915298 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915301 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915304 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915306 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915309 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915311 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915314 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915316 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915319 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915322 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915324 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915327 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915330 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915332 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915335 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915337 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915340 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.916797 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915343 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915345 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915348 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915351 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915354 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915356 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915359 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915361 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915364 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915366 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915371 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915375 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915378 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915381 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915383 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915386 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915388 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915391 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915394 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.917630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915396 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915399 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915410 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915413 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915416 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915419 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915421 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915424 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915426 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915429 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915431 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915434 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915437 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915440 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915443 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915445 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915449 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915451 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915454 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.918381 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915457 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915459 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915461 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915464 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915466 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915469 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915471 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915474 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915476 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915480 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915485 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915489 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915492 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915495 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915497 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915500 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915502 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915505 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915507 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915510 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.918938 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915512 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915515 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915517 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915520 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915522 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915525 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915527 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915530 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915532 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915535 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915538 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915543 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915545 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915548 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915551 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915553 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915555 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915558 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915561 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915563 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915565 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.919461 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915568 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915943 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915947 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915950 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915953 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915955 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915958 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915961 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915964 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915967 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915969 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915972 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915974 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915976 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915979 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915981 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915984 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915987 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915990 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915992 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.919975 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915994 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.915997 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916000 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916003 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916005 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916007 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916010 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916013 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916015 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916017 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916020 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916022 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916025 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916027 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916030 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916033 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916037 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916042 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916045 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.920472 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916048 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916051 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916054 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916057 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916060 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916062 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916065 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916068 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916071 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916073 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916076 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916078 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916080 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916083 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916086 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916089 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916091 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916094 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916096 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916098 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.920937 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916101 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916103 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916105 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916108 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916110 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916113 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916115 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916117 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916121 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916123 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916125 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916128 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916130 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916133 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916135 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916138 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916141 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916144 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916147 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.921427 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916150 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916152 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916155 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916158 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916160 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916163 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916165 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916168 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916170 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916190 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916194 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916198 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916202 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916206 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916209 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916212 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916215 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916217 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916220 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916223 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.921890 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916225 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.916228 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916308 2582 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916319 2582 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916328 2582 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916335 2582 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916339 2582 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916342 2582 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916346 2582 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916350 2582 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916354 2582 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916357 2582 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916360 2582 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916363 2582 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916366 2582 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916369 2582 flags.go:64] FLAG: --cgroup-root="" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916372 2582 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916375 2582 flags.go:64] FLAG: --client-ca-file="" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916378 2582 flags.go:64] FLAG: --cloud-provider="external" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916381 2582 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916384 2582 flags.go:64] FLAG: --cluster-domain="" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916387 2582 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916394 2582 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 06:51:47.922410 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916397 2582 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916401 2582 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916404 2582 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916408 2582 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916411 2582 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916414 2582 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916417 2582 flags.go:64] FLAG: --contention-profiling="false" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916420 2582 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916423 2582 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916426 2582 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916429 2582 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916433 2582 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916436 2582 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916438 2582 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916441 2582 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916444 2582 flags.go:64] FLAG: --enable-server="true" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916447 2582 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916451 2582 flags.go:64] FLAG: --event-burst="100" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916454 2582 flags.go:64] FLAG: --event-qps="50" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916457 2582 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916460 2582 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916462 2582 flags.go:64] FLAG: --eviction-hard="" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916466 2582 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916469 2582 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916473 2582 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 06:51:47.922960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916475 2582 flags.go:64] FLAG: --eviction-soft="" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916479 2582 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916482 2582 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916484 2582 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916487 2582 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916490 2582 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916494 2582 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916497 2582 flags.go:64] FLAG: --feature-gates="" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916501 2582 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916504 2582 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916507 2582 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916510 2582 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916513 2582 flags.go:64] FLAG: --healthz-port="10248" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916516 2582 flags.go:64] FLAG: --help="false" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916518 2582 flags.go:64] FLAG: --hostname-override="ip-10-0-138-102.ec2.internal" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916521 2582 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916524 2582 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916526 2582 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916529 2582 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916533 2582 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916535 2582 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916538 2582 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916541 2582 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 06:51:47.923574 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916543 2582 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916546 2582 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916549 2582 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916552 2582 flags.go:64] FLAG: --kube-reserved="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916555 2582 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916558 2582 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916561 2582 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916563 2582 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916567 2582 flags.go:64] FLAG: --lock-file="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916569 2582 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916572 2582 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916575 2582 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916580 2582 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916583 2582 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916586 2582 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916589 2582 flags.go:64] FLAG: --logging-format="text" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916592 2582 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916597 2582 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916599 2582 flags.go:64] FLAG: --manifest-url="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916602 2582 flags.go:64] FLAG: --manifest-url-header="" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916606 2582 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916610 2582 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916613 2582 flags.go:64] FLAG: --max-pods="110" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916616 2582 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916619 2582 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 06:51:47.924201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916622 2582 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916625 2582 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916627 2582 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916630 2582 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916633 2582 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916640 2582 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916643 2582 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916645 2582 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916648 2582 flags.go:64] FLAG: --pod-cidr="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916651 2582 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916656 2582 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916659 2582 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916662 2582 flags.go:64] FLAG: --pods-per-core="0" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916665 2582 flags.go:64] FLAG: --port="10250" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916668 2582 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916672 2582 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0cce55d1119230096" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916675 2582 flags.go:64] FLAG: --qos-reserved="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916678 2582 flags.go:64] FLAG: --read-only-port="10255" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916681 2582 flags.go:64] FLAG: --register-node="true" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916684 2582 flags.go:64] FLAG: --register-with-taints="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916687 2582 flags.go:64] FLAG: --registry-burst="10" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916690 2582 flags.go:64] FLAG: --registry-qps="5" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916693 2582 flags.go:64] FLAG: --reserved-cpus="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916697 2582 flags.go:64] FLAG: --reserved-memory="" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916700 2582 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 06:51:47.924862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916704 2582 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916707 2582 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916710 2582 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916712 2582 flags.go:64] FLAG: --runonce="false" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916715 2582 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916718 2582 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916721 2582 flags.go:64] FLAG: --seccomp-default="false" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916724 2582 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916726 2582 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916729 2582 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916732 2582 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916735 2582 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916738 2582 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916740 2582 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916743 2582 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916746 2582 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916748 2582 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916751 2582 flags.go:64] FLAG: --system-cgroups="" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916754 2582 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916759 2582 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916762 2582 flags.go:64] FLAG: --tls-cert-file="" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916764 2582 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916769 2582 flags.go:64] FLAG: --tls-min-version="" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916772 2582 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916775 2582 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 06:51:47.925490 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916777 2582 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916781 2582 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916783 2582 flags.go:64] FLAG: --v="2" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916787 2582 flags.go:64] FLAG: --version="false" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916796 2582 flags.go:64] FLAG: --vmodule="" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916802 2582 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.916805 2582 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917790 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917805 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917809 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917814 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917818 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917822 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917827 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917837 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917842 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917847 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917851 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917855 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917859 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917863 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.926089 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917867 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917871 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917878 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917884 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917888 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917892 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917901 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917905 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917912 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917916 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917920 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917924 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917930 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917936 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917940 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917944 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917949 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917954 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917963 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.926665 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917967 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917972 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917976 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917980 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917984 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917988 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917993 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.917996 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918000 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918005 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918009 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918013 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918021 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918025 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918029 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918033 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918037 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918041 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918045 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918049 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.927125 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918053 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918059 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918063 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918070 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918080 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918085 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918089 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918094 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918098 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918104 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918108 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918112 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918116 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918120 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918125 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918130 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918134 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918142 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918147 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.927669 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918151 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918155 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918160 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918164 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918168 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918190 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918195 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918200 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918205 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918209 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918219 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918224 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918229 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918233 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918239 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918243 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918247 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918251 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918255 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918259 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.928124 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918263 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918267 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918273 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918281 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918286 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918290 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.918294 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.918829 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.925932 2582 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.925948 2582 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.925967 2582 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.925977 2582 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926033 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926038 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926041 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.928630 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926044 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926047 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926049 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926054 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926058 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926061 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926064 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926067 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926069 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926072 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926075 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926077 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926080 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926082 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926085 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926087 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926090 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926093 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926096 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.929031 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926099 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926102 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926105 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926107 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926110 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926112 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926115 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926118 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926121 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926124 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926126 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926129 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926131 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926135 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926139 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926142 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926144 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926147 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926150 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.929515 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926153 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926155 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926158 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926160 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926164 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926167 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926170 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926190 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926194 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926197 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926200 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926203 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926205 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926208 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926212 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926215 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926217 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926220 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926222 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926225 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.929964 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926228 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926231 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926234 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926236 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926238 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926241 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926244 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926246 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926249 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926251 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926254 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926256 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926259 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926261 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926264 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926266 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926269 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926271 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926273 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926276 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.930486 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926278 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926281 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926283 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926286 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926288 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926291 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926294 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926297 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926300 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926302 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926305 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926307 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926310 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926312 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926315 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926317 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926320 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.931008 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926322 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.926327 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926446 2582 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926452 2582 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926455 2582 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926458 2582 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926460 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926463 2582 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926466 2582 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926468 2582 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926471 2582 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926473 2582 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926476 2582 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926478 2582 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 06:51:47.931451 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926481 2582 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926485 2582 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926488 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926491 2582 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926493 2582 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926496 2582 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926498 2582 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926500 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926503 2582 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926510 2582 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926513 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926515 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926518 2582 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926520 2582 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926523 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926526 2582 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926528 2582 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926531 2582 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926533 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926536 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 06:51:47.931794 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926538 2582 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926541 2582 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926543 2582 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926546 2582 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926548 2582 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926550 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926553 2582 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926555 2582 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926557 2582 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926560 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926562 2582 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926564 2582 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926567 2582 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926571 2582 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926574 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926576 2582 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926579 2582 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926582 2582 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926584 2582 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 06:51:47.932321 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926587 2582 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926590 2582 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926592 2582 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926595 2582 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926597 2582 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926600 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926603 2582 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926606 2582 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926608 2582 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926610 2582 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926613 2582 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926615 2582 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926617 2582 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926620 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926622 2582 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926624 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926627 2582 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926629 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926632 2582 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926634 2582 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 06:51:47.932776 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926636 2582 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926639 2582 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926641 2582 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926644 2582 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926646 2582 feature_gate.go:328] unrecognized feature gate: Example Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926648 2582 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926651 2582 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926653 2582 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926655 2582 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926658 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926660 2582 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926663 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926665 2582 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926668 2582 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926671 2582 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926673 2582 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926677 2582 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926679 2582 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926682 2582 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926685 2582 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 06:51:47.933353 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926687 2582 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926691 2582 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926694 2582 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926697 2582 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926700 2582 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926703 2582 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926705 2582 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:47.926708 2582 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.926713 2582 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.926825 2582 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.928807 2582 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.930061 2582 server.go:1019] "Starting client certificate rotation" Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.930165 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:51:47.933873 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.930221 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 06:51:47.934205 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.932226 2582 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:51:47.936463 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.936448 2582 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 06:51:47.949328 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.949306 2582 log.go:25] "Validated CRI v1 runtime API" Jul 28 06:51:47.952456 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.952438 2582 log.go:25] "Validated CRI v1 image API" Jul 28 06:51:47.953285 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.953259 2582 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 06:51:47.955583 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.955560 2582 fs.go:135] Filesystem UUIDs: map[2a1ff156-5841-4abe-be8c-e1631375fee1:/dev/nvme0n1p3 60c4c461-1d8a-4578-b279-386474454af9:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 28 06:51:47.955644 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.955579 2582 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 06:51:47.958413 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.958137 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:51:47.960835 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.960725 2582 manager.go:216] Machine: {Timestamp:2026-07-28 06:51:47.960164029 +0000 UTC m=+0.303203901 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3121385 MemoryCapacity:32812175360 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec212502f60e4401e1b0a1e11b337827 SystemUUID:ec212502-f60e-4401-e1b0-a1e11b337827 BootID:3eb527ca-4e33-4f0b-8725-763758ae79e6 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406085632 Type:vfs Inodes:4005392 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:17:c0:ef:a1:cf Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:17:c0:ef:a1:cf Speed:0 Mtu:9001} {Name:ovs-system MacAddress:fe:22:8c:35:61:76 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812175360 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 06:51:47.960835 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.960827 2582 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 06:51:47.960951 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.960911 2582 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 06:51:47.963663 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.963636 2582 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 06:51:47.963798 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.963667 2582 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 06:51:47.964332 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.964322 2582 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 06:51:47.964363 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.964334 2582 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 06:51:47.964363 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.964342 2582 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:51:47.964922 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.964912 2582 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 06:51:47.965637 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.965627 2582 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 06:51:47.967333 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967321 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:51:47.967663 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967652 2582 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 06:51:47.967694 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967686 2582 kubelet.go:486] "Attempting to sync node with API server" Jul 28 06:51:47.967720 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967697 2582 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 06:51:47.967720 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967710 2582 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 06:51:47.967720 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967719 2582 kubelet.go:398] "Adding apiserver pod source" Jul 28 06:51:47.967806 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.967729 2582 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 06:51:47.968111 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.968098 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:51:47.968196 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.968118 2582 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 06:51:47.970247 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.970221 2582 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 06:51:47.971916 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.971902 2582 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 06:51:47.971962 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.971933 2582 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 06:51:47.973537 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973524 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 06:51:47.973581 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973542 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 06:51:47.973581 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973563 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 06:51:47.973581 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973569 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 06:51:47.973581 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973578 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973585 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973594 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973599 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973606 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973612 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973620 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973625 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973650 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 06:51:47.973718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.973656 2582 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 06:51:47.977234 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.977213 2582 server.go:1268] "Started kubelet" Jul 28 06:51:47.977476 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.977408 2582 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 06:51:47.977615 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.977554 2582 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 06:51:47.977718 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.977623 2582 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 06:51:47.978248 ip-10-0-138-102 systemd[1]: Started Kubernetes Kubelet. Jul 28 06:51:47.978509 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.978380 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 06:51:47.978509 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.978393 2582 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 06:51:47.978509 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.978428 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 06:51:47.979142 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.979125 2582 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 06:51:47.979460 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.979445 2582 server.go:310] "Adding debug handlers to kubelet server" Jul 28 06:51:47.982378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.981572 2582 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-102.ec2.internal.18c66180c45db9ab default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-102.ec2.internal,UID:ip-10-0-138-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-102.ec2.internal,},FirstTimestamp:2026-07-28 06:51:47.977165227 +0000 UTC m=+0.320205098,LastTimestamp:2026-07-28 06:51:47.977165227 +0000 UTC m=+0.320205098,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-102.ec2.internal,}" Jul 28 06:51:47.983113 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.983093 2582 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 06:51:47.985111 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985096 2582 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 06:51:47.985207 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985142 2582 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 06:51:47.985269 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.985225 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:47.985634 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985618 2582 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 06:51:47.985742 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985727 2582 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 06:51:47.985845 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985624 2582 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 06:51:47.985906 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985896 2582 reconstruct.go:97] "Volume reconstruction finished" Jul 28 06:51:47.985906 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985905 2582 reconciler.go:29] "Reconciler: start to sync state" Jul 28 06:51:47.985988 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985950 2582 factory.go:55] Registering systemd factory Jul 28 06:51:47.985988 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.985965 2582 factory.go:223] Registration of the systemd container factory successfully Jul 28 06:51:47.986358 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986322 2582 factory.go:153] Registering CRI-O factory Jul 28 06:51:47.986358 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986338 2582 factory.go:223] Registration of the crio container factory successfully Jul 28 06:51:47.986450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986387 2582 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 06:51:47.986450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986411 2582 factory.go:103] Registering Raw factory Jul 28 06:51:47.986450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986425 2582 manager.go:1196] Started watching for new ooms in manager Jul 28 06:51:47.986822 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.986808 2582 manager.go:349] Starting recovery of all containers Jul 28 06:51:47.988045 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.988011 2582 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 06:51:47.995952 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:47.989989 2582 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 06:51:47.998721 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:47.998540 2582 manager.go:354] Recovery completed Jul 28 06:51:48.000218 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.000194 2582 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 28 06:51:48.003333 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.003320 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.003969 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.003950 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmw5n" Jul 28 06:51:48.005375 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005360 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.005444 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005389 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.005444 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005400 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.005929 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005915 2582 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 06:51:48.005929 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005929 2582 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 06:51:48.006037 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005930 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.006037 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.005947 2582 state_mem.go:36] "Initialized new in-memory state store" Jul 28 06:51:48.006649 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.006633 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.006697 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.006668 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.006697 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.006683 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.007610 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.007599 2582 policy_none.go:49] "None policy: Start" Jul 28 06:51:48.007643 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.007615 2582 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 06:51:48.007643 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.007625 2582 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 06:51:48.008493 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.008482 2582 policy_none.go:47] "Start" Jul 28 06:51:48.009023 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.009009 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-wmw5n" Jul 28 06:51:48.049818 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.049800 2582 manager.go:337] "Starting Device Plugin manager" Jul 28 06:51:48.049952 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.049847 2582 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 06:51:48.049952 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.049862 2582 server.go:87] "Starting device plugin registration server" Jul 28 06:51:48.050145 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.050131 2582 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 06:51:48.050218 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.050147 2582 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 06:51:48.050268 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.050238 2582 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 06:51:48.050338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.050327 2582 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 06:51:48.050378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.050340 2582 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 06:51:48.050957 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.050938 2582 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 06:51:48.051034 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.050989 2582 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.150420 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.150392 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.151368 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.151351 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.151440 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.151381 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.151440 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.151392 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.151440 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.151430 2582 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.160339 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.160297 2582 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.160339 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.160318 2582 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-102.ec2.internal\": node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.169463 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.169432 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 06:51:48.170745 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.170725 2582 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 06:51:48.170864 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.170765 2582 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 06:51:48.170864 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.170786 2582 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 06:51:48.170864 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.170819 2582 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 06:51:48.173010 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.172984 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:48.180565 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.180542 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.271066 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.271019 2582 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal"] Jul 28 06:51:48.271266 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.271120 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.272756 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.272734 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.272856 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.272770 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.272856 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.272782 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.274002 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.273990 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.274128 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274115 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.274167 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274145 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274864 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274891 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274906 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274866 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274971 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.275166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.274984 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.276062 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.276044 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.276132 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.276075 2582 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 06:51:48.276770 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.276756 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientMemory" Jul 28 06:51:48.276853 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.276785 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 06:51:48.276853 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.276802 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeHasSufficientPID" Jul 28 06:51:48.280958 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.280941 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.288264 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.288248 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.288339 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.288272 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.288339 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.288293 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad4bef192bb3177a88105cc53b643b33-config\") pod \"kube-apiserver-proxy-ip-10-0-138-102.ec2.internal\" (UID: \"ad4bef192bb3177a88105cc53b643b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.290711 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.290696 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-102.ec2.internal\" not found" node="ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.293974 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.293957 2582 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-102.ec2.internal\" not found" node="ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.381279 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.381235 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.388652 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388629 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.388749 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388655 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.388749 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388723 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.388823 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388774 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0ba40c31a278c0c8d23321215edde4ce-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal\" (UID: \"0ba40c31a278c0c8d23321215edde4ce\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.388823 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad4bef192bb3177a88105cc53b643b33-config\") pod \"kube-apiserver-proxy-ip-10-0-138-102.ec2.internal\" (UID: \"ad4bef192bb3177a88105cc53b643b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.388823 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.388813 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/ad4bef192bb3177a88105cc53b643b33-config\") pod \"kube-apiserver-proxy-ip-10-0-138-102.ec2.internal\" (UID: \"ad4bef192bb3177a88105cc53b643b33\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.482151 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.482079 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.582589 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.582542 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.593083 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.593062 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.597485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.597094 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:48.682873 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.682838 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.784023 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.784000 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.800506 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.800481 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:48.884738 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.884712 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:48.931519 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.931491 2582 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 06:51:48.932127 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.931681 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 06:51:48.932127 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:48.931681 2582 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 06:51:48.985431 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:48.985403 2582 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-102.ec2.internal\" not found" Jul 28 06:51:49.013585 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.013538 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 06:46:48 +0000 UTC" deadline="2028-03-21 20:48:20.947768354 +0000 UTC" Jul 28 06:51:49.013585 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.013578 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14461h56m31.934193737s" Jul 28 06:51:49.032722 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.032665 2582 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:49.072899 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:49.072864 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0ba40c31a278c0c8d23321215edde4ce.slice/crio-810fbc76d4cbb34800a3b66275b403f4ec9e4e2c5ed8f00755dba6f937dcce1c WatchSource:0}: Error finding container 810fbc76d4cbb34800a3b66275b403f4ec9e4e2c5ed8f00755dba6f937dcce1c: Status 404 returned error can't find the container with id 810fbc76d4cbb34800a3b66275b403f4ec9e4e2c5ed8f00755dba6f937dcce1c Jul 28 06:51:49.077835 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.077818 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:51:49.086290 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.086272 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" Jul 28 06:51:49.099270 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.099241 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:51:49.100946 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.100932 2582 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" Jul 28 06:51:49.109942 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.109928 2582 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 06:51:49.174926 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.174877 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" event={"ID":"0ba40c31a278c0c8d23321215edde4ce","Type":"ContainerStarted","Data":"810fbc76d4cbb34800a3b66275b403f4ec9e4e2c5ed8f00755dba6f937dcce1c"} Jul 28 06:51:49.418765 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.418672 2582 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:49.476456 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:49.476410 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad4bef192bb3177a88105cc53b643b33.slice/crio-3b805ba4d0d5c1731d3803f501d0647cf527bbd56d8e2ee082217560b87a48c2 WatchSource:0}: Error finding container 3b805ba4d0d5c1731d3803f501d0647cf527bbd56d8e2ee082217560b87a48c2: Status 404 returned error can't find the container with id 3b805ba4d0d5c1731d3803f501d0647cf527bbd56d8e2ee082217560b87a48c2 Jul 28 06:51:49.968494 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.968459 2582 apiserver.go:52] "Watching apiserver" Jul 28 06:51:49.979320 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.979294 2582 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 06:51:49.979800 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.979778 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wl9tg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal","openshift-multus/multus-sj4wh","openshift-network-diagnostics/network-check-target-tz9k8","kube-system/global-pull-secret-syncer-r29hp","kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal","openshift-cluster-node-tuning-operator/tuned-s7xh6","openshift-multus/multus-additional-cni-plugins-pvqns","openshift-multus/network-metrics-daemon-5rhzj","openshift-network-operator/iptables-alerter-9kmk7","openshift-ovn-kubernetes/ovnkube-node-xtlbk","kube-system/konnectivity-agent-9wfk4","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq","openshift-dns/node-resolver-fgzpd"] Jul 28 06:51:49.981468 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.981440 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:49.982629 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.982608 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.983623 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.983602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:49.983725 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:49.983679 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:51:49.984329 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.984308 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.984487 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.984467 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6fvzw\"" Jul 28 06:51:49.984564 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.984519 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 06:51:49.984872 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.984743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:49.984872 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:49.984820 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:49.984872 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.984847 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.985280 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.985254 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 06:51:49.985694 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.985460 2582 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 06:51:49.985694 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.985507 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.985694 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.985564 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 06:51:49.985960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.985941 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.986406 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.986386 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rdsnw\"" Jul 28 06:51:49.986756 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.986737 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.988088 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.988066 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:49.989016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.988995 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.989221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.989185 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bdwpw\"" Jul 28 06:51:49.989357 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.989336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.989579 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.989563 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:49.989656 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:49.989629 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:51:49.990862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.990835 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:49.991271 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.991234 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 06:51:49.992274 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.992235 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 06:51:49.992369 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.992321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-5p9d5\"" Jul 28 06:51:49.994007 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.993733 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:49.994103 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.994054 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fz4ds\"" Jul 28 06:51:49.994190 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.994172 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 06:51:49.994323 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.994085 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.994884 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.994862 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.995444 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.995423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:49.996545 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.996527 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:49.997416 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997387 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-qz4fg\"" Jul 28 06:51:49.997516 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997440 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 06:51:49.997516 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997464 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.997516 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997508 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 06:51:49.997677 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997597 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.997761 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997674 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 06:51:49.997817 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997784 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 06:51:49.997817 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997788 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysconfig\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-socket-dir-parent\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997872 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-netns\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997880 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997897 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-bin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.997925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997922 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-etc-kubernetes\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.997948 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g42sg\" (UniqueName: \"kubernetes.io/projected/dc965fc2-bbb8-4297-b840-45ea36c987e8-kube-api-access-g42sg\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998015 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998051 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-conf\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998056 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998098 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998068 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-sys\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-lib-modules\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998193 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-var-lib-kubelet\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998216 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b41361a-8b8b-4c72-9141-f21158c72f09-host\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7khv\" (UniqueName: \"kubernetes.io/projected/6b41361a-8b8b-4c72-9141-f21158c72f09-kube-api-access-f7khv\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998287 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-conf-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998332 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-dbus\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998347 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-rx4fx\"" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998396 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqv75\" (UniqueName: \"kubernetes.io/projected/57bcca38-0be5-406a-953b-604af66d6db2-kube-api-access-gqv75\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998432 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b41361a-8b8b-4c72-9141-f21158c72f09-serviceca\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-multus\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998528 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998554 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-run\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-hostroot\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998636 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-modprobe-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.998679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998665 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-kubernetes\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998692 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-systemd\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998716 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-system-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998639 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998741 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-cnibin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998767 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-daemon-config\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998804 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-multus-certs\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998876 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-k8s-cni-cncf-io\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998976 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.998999 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999030 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-nskwg\"" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-kubelet\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999202 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-kubelet-config\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999233 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-etc-tuned\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999257 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-host\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999281 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-tmp\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999305 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-os-release\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:49.999327 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:49.999329 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-cni-binary-copy\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.000292 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.000195 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 06:51:50.000292 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.000210 2582 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 06:51:50.000417 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.000399 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-jzx2n\"" Jul 28 06:51:50.000520 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.000505 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 06:51:50.019112 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.019084 2582 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-69x8m" Jul 28 06:51:50.027424 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.027401 2582 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-69x8m" Jul 28 06:51:50.086764 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.086732 2582 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 06:51:50.099754 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099720 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-ovn\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.099754 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099757 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-host\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.099754 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099778 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-tmp\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099794 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-os-release\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-cni-binary-copy\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099829 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099840 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-host\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099856 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-etc-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099930 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-os-release\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099942 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysconfig\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099974 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g42sg\" (UniqueName: \"kubernetes.io/projected/dc965fc2-bbb8-4297-b840-45ea36c987e8-kube-api-access-g42sg\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.099997 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100073 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-os-release\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100098 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysconfig\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100105 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtrtb\" (UniqueName: \"kubernetes.io/projected/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-kube-api-access-wtrtb\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100137 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-conf\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100164 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-sys\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100180 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b41361a-8b8b-4c72-9141-f21158c72f09-host\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100218 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7khv\" (UniqueName: \"kubernetes.io/projected/6b41361a-8b8b-4c72-9141-f21158c72f09-kube-api-access-f7khv\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100267 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-conf-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100292 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100297 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-sys\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100321 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vjzf6\" (UniqueName: \"kubernetes.io/projected/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-kube-api-access-vjzf6\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100371 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6b41361a-8b8b-4c72-9141-f21158c72f09-host\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100407 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-conf-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100281 2582 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100409 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-systemd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.100439 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-kubelet\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.100504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100500 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-log-socket\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100525 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-cni-binary-copy\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.100540 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:50.600496222 +0000 UTC m=+2.943536083 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100603 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-script-lib\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100623 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-conf\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100634 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcd63612-cfa5-441e-9149-bc7d6026553a-konnectivity-ca\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100667 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-run\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100713 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-hostroot\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100722 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-run\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100751 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-config\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100761 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-hostroot\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100781 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-kubernetes\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-multus-certs\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-kubelet-config\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100842 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-kubernetes\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-multus-certs\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100895 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-kubelet-config\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.101533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100910 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100941 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100972 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.100999 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjrhc\" (UniqueName: \"kubernetes.io/projected/450c1e35-14f1-4d48-85b9-34121c7aae86-kube-api-access-pjrhc\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101027 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-device-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101096 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-etc-tuned\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101111 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-sysctl-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-bin\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101149 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcd63612-cfa5-441e-9149-bc7d6026553a-agent-certs\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101199 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101265 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-socket-dir-parent\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101355 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-socket-dir-parent\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101357 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-netns\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101401 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-bin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101428 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-etc-kubernetes\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-dbus\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.102370 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101472 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-netns\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101484 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7zrpf\" (UniqueName: \"kubernetes.io/projected/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-kube-api-access-7zrpf\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101501 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-bin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101516 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-node-log\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101503 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-etc-kubernetes\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101541 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-lib-modules\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101565 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-var-lib-kubelet\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101591 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101609 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ebea1bb7-d532-4665-8c84-6b0efc41db93-dbus\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101617 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101647 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-netd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101663 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-var-lib-kubelet\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101665 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-lib-modules\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101674 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjwsf\" (UniqueName: \"kubernetes.io/projected/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kube-api-access-zjwsf\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101731 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqv75\" (UniqueName: \"kubernetes.io/projected/57bcca38-0be5-406a-953b-604af66d6db2-kube-api-access-gqv75\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101760 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b41361a-8b8b-4c72-9141-f21158c72f09-serviceca\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101792 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-multus\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101819 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-hosts-file\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101844 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-tmp-dir\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101869 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-system-cni-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101895 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cnibin\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101918 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101943 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-slash\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101967 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450c1e35-14f1-4d48-85b9-34121c7aae86-ovn-node-metrics-cert\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.101993 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102018 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-socket-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102042 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-registration-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102062 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-cni-multus\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102067 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102118 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-sys-fs\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102148 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-modprobe-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102174 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-systemd\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102216 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-system-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102240 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-cnibin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.103710 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102264 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-daemon-config\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102292 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kzk7t\" (UniqueName: \"kubernetes.io/projected/2e0526d0-2279-4ced-b33d-22376dab5808-kube-api-access-kzk7t\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102339 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102367 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-k8s-cni-cncf-io\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102394 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-kubelet\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102424 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-iptables-alerter-script\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102430 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/6b41361a-8b8b-4c72-9141-f21158c72f09-serviceca\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102448 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-host-slash\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102466 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-modprobe-d\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102476 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-systemd-units\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102508 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/57bcca38-0be5-406a-953b-604af66d6db2-etc-systemd\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102515 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-netns\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102570 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-system-cni-dir\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102579 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-var-lib-kubelet\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102607 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-var-lib-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102633 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-cnibin\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102637 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-env-overrides\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.104521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.102581 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/dc965fc2-bbb8-4297-b840-45ea36c987e8-host-run-k8s-cni-cncf-io\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.105497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.103012 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/dc965fc2-bbb8-4297-b840-45ea36c987e8-multus-daemon-config\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.105497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.104301 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-tmp\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.105497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.104342 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/57bcca38-0be5-406a-953b-604af66d6db2-etc-tuned\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.106791 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.106751 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:50.106791 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.106779 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:50.106791 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.106794 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:50.107101 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.106880 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:51:50.606853668 +0000 UTC m=+2.949893530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:50.110106 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.109760 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7khv\" (UniqueName: \"kubernetes.io/projected/6b41361a-8b8b-4c72-9141-f21158c72f09-kube-api-access-f7khv\") pod \"node-ca-wl9tg\" (UID: \"6b41361a-8b8b-4c72-9141-f21158c72f09\") " pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.110106 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.109776 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g42sg\" (UniqueName: \"kubernetes.io/projected/dc965fc2-bbb8-4297-b840-45ea36c987e8-kube-api-access-g42sg\") pod \"multus-sj4wh\" (UID: \"dc965fc2-bbb8-4297-b840-45ea36c987e8\") " pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.110106 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.110070 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqv75\" (UniqueName: \"kubernetes.io/projected/57bcca38-0be5-406a-953b-604af66d6db2-kube-api-access-gqv75\") pod \"tuned-s7xh6\" (UID: \"57bcca38-0be5-406a-953b-604af66d6db2\") " pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.147413 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.147375 2582 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:50.178168 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.178124 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" event={"ID":"ad4bef192bb3177a88105cc53b643b33","Type":"ContainerStarted","Data":"3b805ba4d0d5c1731d3803f501d0647cf527bbd56d8e2ee082217560b87a48c2"} Jul 28 06:51:50.203226 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203177 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vjzf6\" (UniqueName: \"kubernetes.io/projected/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-kube-api-access-vjzf6\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.203226 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-systemd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203265 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-kubelet\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203287 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-log-socket\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203310 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-script-lib\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203330 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-systemd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203342 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-kubelet\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203334 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcd63612-cfa5-441e-9149-bc7d6026553a-konnectivity-ca\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203405 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-config\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203396 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-log-socket\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203445 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.203485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203475 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203503 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjrhc\" (UniqueName: \"kubernetes.io/projected/450c1e35-14f1-4d48-85b9-34121c7aae86-kube-api-access-pjrhc\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203529 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-device-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-bin\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203579 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcd63612-cfa5-441e-9149-bc7d6026553a-agent-certs\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203582 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7zrpf\" (UniqueName: \"kubernetes.io/projected/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-kube-api-access-7zrpf\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203639 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-node-log\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203668 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203684 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-device-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203699 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203726 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-netd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-node-log\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203752 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjwsf\" (UniqueName: \"kubernetes.io/projected/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kube-api-access-zjwsf\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-bin\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203783 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-hosts-file\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-tmp-dir\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.204036 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203835 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-system-cni-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203862 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cnibin\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203888 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203913 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-slash\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203938 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450c1e35-14f1-4d48-85b9-34121c7aae86-ovn-node-metrics-cert\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203965 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203988 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-ovn-kubernetes\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203996 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-script-lib\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203991 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-socket-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204032 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-registration-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.204047 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204060 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-hosts-file\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204099 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-socket-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204059 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204565 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204654 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-sys-fs\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.204704 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.204710 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:50.704681068 +0000 UTC m=+3.047720943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204728 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-sys-fs\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204772 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kzk7t\" (UniqueName: \"kubernetes.io/projected/2e0526d0-2279-4ced-b33d-22376dab5808-kube-api-access-kzk7t\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204808 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-iptables-alerter-script\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204878 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-host-slash\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204911 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-systemd-units\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204943 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-netns\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204954 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-tmp-dir\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.204975 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-var-lib-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205002 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-env-overrides\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205035 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-ovn\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205075 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205107 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-etc-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205133 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205197 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-os-release\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205234 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-ovnkube-config\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.205787 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205299 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-system-cni-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205346 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-cni-netd\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205423 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-host-slash\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205463 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cnibin\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205483 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-systemd-units\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205534 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-run-netns\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205547 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.203964 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/fcd63612-cfa5-441e-9149-bc7d6026553a-konnectivity-ca\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205601 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-ovn\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205649 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-registration-dir\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205732 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-run-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.205935 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-os-release\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206020 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-host-slash\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206536 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-etc-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206550 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-binary-copy\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206627 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-etc-selinux\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206653 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/450c1e35-14f1-4d48-85b9-34121c7aae86-var-lib-openvswitch\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.206744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.206653 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtrtb\" (UniqueName: \"kubernetes.io/projected/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-kube-api-access-wtrtb\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.207614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207226 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.207614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207264 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/450c1e35-14f1-4d48-85b9-34121c7aae86-env-overrides\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.207614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207364 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/450c1e35-14f1-4d48-85b9-34121c7aae86-ovn-node-metrics-cert\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.207614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-iptables-alerter-script\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.207614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207597 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/fcd63612-cfa5-441e-9149-bc7d6026553a-agent-certs\") pod \"konnectivity-agent-9wfk4\" (UID: \"fcd63612-cfa5-441e-9149-bc7d6026553a\") " pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.209042 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.207920 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.212026 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.212005 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vjzf6\" (UniqueName: \"kubernetes.io/projected/f1c34b94-f4b9-4c33-8535-5acb369ef0cf-kube-api-access-vjzf6\") pod \"node-resolver-fgzpd\" (UID: \"f1c34b94-f4b9-4c33-8535-5acb369ef0cf\") " pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.212737 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.212713 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjrhc\" (UniqueName: \"kubernetes.io/projected/450c1e35-14f1-4d48-85b9-34121c7aae86-kube-api-access-pjrhc\") pod \"ovnkube-node-xtlbk\" (UID: \"450c1e35-14f1-4d48-85b9-34121c7aae86\") " pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.212892 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.212870 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7zrpf\" (UniqueName: \"kubernetes.io/projected/59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4-kube-api-access-7zrpf\") pod \"multus-additional-cni-plugins-pvqns\" (UID: \"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4\") " pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.218890 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.218844 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtrtb\" (UniqueName: \"kubernetes.io/projected/37a1165a-51de-4346-a3e9-3aa2bafb4b1a-kube-api-access-wtrtb\") pod \"iptables-alerter-9kmk7\" (UID: \"37a1165a-51de-4346-a3e9-3aa2bafb4b1a\") " pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.219843 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.219826 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjwsf\" (UniqueName: \"kubernetes.io/projected/d0dbc4da-bdfc-4970-8e0b-46329a594ce9-kube-api-access-zjwsf\") pod \"aws-ebs-csi-driver-node-6khlq\" (UID: \"d0dbc4da-bdfc-4970-8e0b-46329a594ce9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.219938 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.219922 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kzk7t\" (UniqueName: \"kubernetes.io/projected/2e0526d0-2279-4ced-b33d-22376dab5808-kube-api-access-kzk7t\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.296296 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.296262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wl9tg" Jul 28 06:51:50.303316 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.303294 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-sj4wh" Jul 28 06:51:50.311903 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.311880 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc965fc2_bbb8_4297_b840_45ea36c987e8.slice/crio-15b2f764bd794fb2d122865aa6ede16c16a86e900d5da74424235c6399faca7c WatchSource:0}: Error finding container 15b2f764bd794fb2d122865aa6ede16c16a86e900d5da74424235c6399faca7c: Status 404 returned error can't find the container with id 15b2f764bd794fb2d122865aa6ede16c16a86e900d5da74424235c6399faca7c Jul 28 06:51:50.312679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.312659 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" Jul 28 06:51:50.319533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.319510 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-pvqns" Jul 28 06:51:50.327882 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.327841 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59b6f8c0_5381_4d1b_8f5d_c6b99dfac9d4.slice/crio-61892ea981908e676591b17162140260b02e861f49d161c138b8ea8524effeae WatchSource:0}: Error finding container 61892ea981908e676591b17162140260b02e861f49d161c138b8ea8524effeae: Status 404 returned error can't find the container with id 61892ea981908e676591b17162140260b02e861f49d161c138b8ea8524effeae Jul 28 06:51:50.328684 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.328662 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-9kmk7" Jul 28 06:51:50.336910 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.336889 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:51:50.337616 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.337589 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37a1165a_51de_4346_a3e9_3aa2bafb4b1a.slice/crio-c08e586910cfd8bd39cc97d08a9117c095f37ae4f2ea1994020123010883a6c8 WatchSource:0}: Error finding container c08e586910cfd8bd39cc97d08a9117c095f37ae4f2ea1994020123010883a6c8: Status 404 returned error can't find the container with id c08e586910cfd8bd39cc97d08a9117c095f37ae4f2ea1994020123010883a6c8 Jul 28 06:51:50.343543 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.343208 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:51:50.346497 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.346470 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod450c1e35_14f1_4d48_85b9_34121c7aae86.slice/crio-4cd62551c10646165636e58ae439cc4714c80e5772fd75b5ed4d3cf920461873 WatchSource:0}: Error finding container 4cd62551c10646165636e58ae439cc4714c80e5772fd75b5ed4d3cf920461873: Status 404 returned error can't find the container with id 4cd62551c10646165636e58ae439cc4714c80e5772fd75b5ed4d3cf920461873 Jul 28 06:51:50.349724 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.349699 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" Jul 28 06:51:50.354279 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.354249 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcd63612_cfa5_441e_9149_bc7d6026553a.slice/crio-e600955e7f7864ce1775e07659279d0e56a88b93782ee8a9278d4ebe81d32db2 WatchSource:0}: Error finding container e600955e7f7864ce1775e07659279d0e56a88b93782ee8a9278d4ebe81d32db2: Status 404 returned error can't find the container with id e600955e7f7864ce1775e07659279d0e56a88b93782ee8a9278d4ebe81d32db2 Jul 28 06:51:50.355799 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.355623 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-fgzpd" Jul 28 06:51:50.366637 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:51:50.366605 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd0dbc4da_bdfc_4970_8e0b_46329a594ce9.slice/crio-02eb90740a49825a79a9abaaf7556eb3374caa140e96401f1e6c7a637a208b45 WatchSource:0}: Error finding container 02eb90740a49825a79a9abaaf7556eb3374caa140e96401f1e6c7a637a208b45: Status 404 returned error can't find the container with id 02eb90740a49825a79a9abaaf7556eb3374caa140e96401f1e6c7a637a208b45 Jul 28 06:51:50.610991 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.610680 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:50.611272 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.611030 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:50.611272 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.610952 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:50.611272 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.611213 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:50.611272 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.611227 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:50.611509 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.611186 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:50.611509 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.611310 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:51:51.611288919 +0000 UTC m=+3.954328804 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:50.611509 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.611334 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:51.611318784 +0000 UTC m=+3.954358662 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:50.711563 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:50.711524 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:50.711752 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.711723 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:50.711834 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:50.711819 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:51.711796321 +0000 UTC m=+4.054836198 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:51.029650 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.029582 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:46:50 +0000 UTC" deadline="2028-03-27 10:00:47.770039004 +0000 UTC" Jul 28 06:51:51.029650 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.029639 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14595h8m56.740403945s" Jul 28 06:51:51.171841 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.171759 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:51.172006 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.171905 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:51.172449 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.172341 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:51.172556 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.172453 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:51:51.195137 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.195101 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" event={"ID":"57bcca38-0be5-406a-953b-604af66d6db2","Type":"ContainerStarted","Data":"3d5986199d6e9cb36beff97adade36bbe0f47a04b6305fdc99c579dc4071680b"} Jul 28 06:51:51.209196 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.208846 2582 generic.go:356] "Generic (PLEG): container finished" podID="0ba40c31a278c0c8d23321215edde4ce" containerID="55ad8a0d45a35be1a00b295dc24fbe2d0d4871a63bce1c192f269b21cdc1bd21" exitCode=0 Jul 28 06:51:51.209196 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.208950 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" event={"ID":"0ba40c31a278c0c8d23321215edde4ce","Type":"ContainerDied","Data":"55ad8a0d45a35be1a00b295dc24fbe2d0d4871a63bce1c192f269b21cdc1bd21"} Jul 28 06:51:51.214901 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.214796 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" event={"ID":"d0dbc4da-bdfc-4970-8e0b-46329a594ce9","Type":"ContainerStarted","Data":"02eb90740a49825a79a9abaaf7556eb3374caa140e96401f1e6c7a637a208b45"} Jul 28 06:51:51.222638 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.222518 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"4cd62551c10646165636e58ae439cc4714c80e5772fd75b5ed4d3cf920461873"} Jul 28 06:51:51.235939 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.235904 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerStarted","Data":"61892ea981908e676591b17162140260b02e861f49d161c138b8ea8524effeae"} Jul 28 06:51:51.243830 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.243797 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj4wh" event={"ID":"dc965fc2-bbb8-4297-b840-45ea36c987e8","Type":"ContainerStarted","Data":"15b2f764bd794fb2d122865aa6ede16c16a86e900d5da74424235c6399faca7c"} Jul 28 06:51:51.252441 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.252356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wl9tg" event={"ID":"6b41361a-8b8b-4c72-9141-f21158c72f09","Type":"ContainerStarted","Data":"33a53896f064accd7b7a50016e687f7d0fce5ed36aa156b3eb2beb127fa288a4"} Jul 28 06:51:51.263953 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.263916 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fgzpd" event={"ID":"f1c34b94-f4b9-4c33-8535-5acb369ef0cf","Type":"ContainerStarted","Data":"529810e92e18acd186245cfd936d24f749dd8f14f70b4b10bc7c2acbeaa53cc3"} Jul 28 06:51:51.280551 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.280430 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wfk4" event={"ID":"fcd63612-cfa5-441e-9149-bc7d6026553a","Type":"ContainerStarted","Data":"e600955e7f7864ce1775e07659279d0e56a88b93782ee8a9278d4ebe81d32db2"} Jul 28 06:51:51.301929 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.301820 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9kmk7" event={"ID":"37a1165a-51de-4346-a3e9-3aa2bafb4b1a","Type":"ContainerStarted","Data":"c08e586910cfd8bd39cc97d08a9117c095f37ae4f2ea1994020123010883a6c8"} Jul 28 06:51:51.342858 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.342628 2582 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.620254 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.620321 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.620465 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.620536 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:53.620516178 +0000 UTC m=+5.963556064 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.621005 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.621026 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.621041 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:51.621202 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.621105 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:51:53.621074136 +0000 UTC m=+5.964114003 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:51.720782 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:51.720734 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:51.720994 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.720959 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:51.721064 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:51.721033 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:53.721011973 +0000 UTC m=+6.064051838 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:52.031167 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:52.030210 2582 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 06:46:50 +0000 UTC" deadline="2028-04-26 03:07:51.356545378 +0000 UTC" Jul 28 06:51:52.031167 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:52.030277 2582 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15308h15m59.326272867s" Jul 28 06:51:52.174961 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:52.174329 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:52.174961 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:52.174474 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:51:53.172455 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:53.171699 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:53.172455 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.171837 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:53.172455 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:53.172298 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:53.172455 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.172401 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:51:53.645237 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:53.645182 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:53.645438 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:53.645260 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:53.645517 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645446 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:53.645517 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645510 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.645491289 +0000 UTC m=+9.988531165 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:53.645621 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645599 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:53.645621 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645612 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:53.645727 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645625 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:53.645727 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.645660 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.645649089 +0000 UTC m=+9.988688965 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:53.746179 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:53.746085 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:53.746392 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.746275 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:53.746392 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:53.746343 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:51:57.746323644 +0000 UTC m=+10.089363520 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:54.173753 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:54.173670 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:54.174318 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:54.173833 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:51:55.171480 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:55.171442 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:55.171679 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:55.171601 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:55.171980 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:55.171962 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:55.172059 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:55.172038 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:51:56.172111 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:56.172033 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:56.172641 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:56.172183 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:51:57.171173 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:57.171082 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:57.171357 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.171243 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:57.171739 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:57.171712 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:57.171876 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.171809 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:51:57.682443 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:57.682390 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:57.682443 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:57.682448 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:57.682992 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.682690 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:57.682992 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.682760 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.682737883 +0000 UTC m=+18.025777745 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:51:57.683352 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.683205 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:51:57.683352 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.683231 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:51:57.683352 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.683244 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:57.683352 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.683316 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.683297139 +0000 UTC m=+18.026337002 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:51:57.783190 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:57.783126 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:57.783386 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.783362 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:57.783446 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:57.783431 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:05.783411031 +0000 UTC m=+18.126450906 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:51:58.173592 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:58.173504 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:51:58.173768 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:58.173659 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:51:59.171458 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:59.171418 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:51:59.171960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:51:59.171463 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:51:59.171960 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:59.171588 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:51:59.171960 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:51:59.171712 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:00.175524 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:00.175492 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:00.175968 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:00.175687 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:01.171805 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:01.171770 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:01.172007 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:01.171899 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:01.172007 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:01.171973 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:01.172117 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:01.172080 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:02.171553 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:02.171468 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:02.171987 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:02.171611 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:03.171430 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:03.171394 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:03.171629 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:03.171527 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:03.171629 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:03.171399 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:03.171629 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:03.171607 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:04.171326 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:04.171289 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:04.171477 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:04.171443 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:05.171546 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:05.171508 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:05.172044 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:05.171496 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:05.172044 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.171684 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:05.172044 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.171786 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:05.744881 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:05.744832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:05.745138 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:05.744889 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:05.745138 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745055 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:05.745138 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745116 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:21.745096351 +0000 UTC m=+34.088136210 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:05.745337 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745317 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:05.745378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745344 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:05.745378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745356 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:05.745441 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.745418 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:21.745405291 +0000 UTC m=+34.088445163 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:05.846161 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:05.846122 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:05.846347 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.846328 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:05.846416 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:05.846405 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:21.846384495 +0000 UTC m=+34.189424360 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:06.171576 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:06.171540 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:06.171955 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:06.171691 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:07.171346 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:07.171312 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:07.171567 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:07.171354 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:07.171567 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:07.171440 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:07.171953 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:07.171586 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:08.171664 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:08.171630 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:08.172060 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:08.171759 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:09.170936 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:09.170900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:09.171102 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:09.170901 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:09.171102 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:09.171059 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:09.171254 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:09.171115 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:10.171507 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:10.171483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:10.171762 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:10.171626 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:10.350862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:10.349827 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" event={"ID":"0ba40c31a278c0c8d23321215edde4ce","Type":"ContainerStarted","Data":"b5107febc2d93383a99ab70e847fc36d65f2dab45b5a9ba79e3d2ee22b51a940"} Jul 28 06:52:10.352888 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:10.351845 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" event={"ID":"ad4bef192bb3177a88105cc53b643b33","Type":"ContainerStarted","Data":"b65244bdbe80c54b46dafba644a078b17f0ae7f2c4a0b2bfc0fab23d68a59af0"} Jul 28 06:52:10.382225 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:10.382114 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-102.ec2.internal" podStartSLOduration=21.382093379 podStartE2EDuration="21.382093379s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:10.366708873 +0000 UTC m=+22.709748757" watchObservedRunningTime="2026-07-28 06:52:10.382093379 +0000 UTC m=+22.725133262" Jul 28 06:52:11.171437 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.171262 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:11.171620 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.171264 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:11.171620 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:11.171531 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:11.172301 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:11.171647 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:11.355348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.355309 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" event={"ID":"57bcca38-0be5-406a-953b-604af66d6db2","Type":"ContainerStarted","Data":"f91ec850a5462a3daa450c2bc3241ec4fa09cd959faa2559c121fe6086127315"} Jul 28 06:52:11.356791 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.356764 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" event={"ID":"d0dbc4da-bdfc-4970-8e0b-46329a594ce9","Type":"ContainerStarted","Data":"38258a1e1e3bd72c5a77d2a4342f33783f8856b579252fe0dc7b33cb5718df00"} Jul 28 06:52:11.359449 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359426 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"055bfd6d86f055ac61d321a71fdced62bf5f9d1da496a75d87d5dd2cc9489a47"} Jul 28 06:52:11.359532 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"4206053568d5d2f5a3e95979a587bcf0588892548df707de61c66731a89f2240"} Jul 28 06:52:11.359586 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359535 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"a86ed5c3e22c0d183ac135894b55ca5931ce083f4baf469d665161d68efe1224"} Jul 28 06:52:11.359640 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359586 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"69da2a8982a30332ec25c86a8cd853a9b06ba0ba0b3a500d4a409abe91ff7df6"} Jul 28 06:52:11.359640 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359619 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"fe8266760e43ee2c72b9840918ffa473b8c08856dc0d73cb997c551fd7cc5f1d"} Jul 28 06:52:11.359756 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.359655 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"a6e99815335c8855f7da2eea7f19fb2d1ae8248a80c8897bc2294d142014367b"} Jul 28 06:52:11.360786 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.360762 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="412dfa2ebfa44ac5ab0c8880a58e3c7e70ab6835a688bbf375f1ed21de444854" exitCode=0 Jul 28 06:52:11.360874 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.360838 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"412dfa2ebfa44ac5ab0c8880a58e3c7e70ab6835a688bbf375f1ed21de444854"} Jul 28 06:52:11.362435 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.362310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-sj4wh" event={"ID":"dc965fc2-bbb8-4297-b840-45ea36c987e8","Type":"ContainerStarted","Data":"1bfdac3701e6861a5dd424c8e6c0c63c4f68d11d58f2c0ad59acd30021c06f81"} Jul 28 06:52:11.363596 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.363575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wl9tg" event={"ID":"6b41361a-8b8b-4c72-9141-f21158c72f09","Type":"ContainerStarted","Data":"64c1c26dc830d5f300374cc840159d2913efa8dd22e7f3ec23820eaa581ff1f8"} Jul 28 06:52:11.364927 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.364908 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-fgzpd" event={"ID":"f1c34b94-f4b9-4c33-8535-5acb369ef0cf","Type":"ContainerStarted","Data":"c4eefb2df289483b73439b4a625121a0832aacf000da5bb3728c1e3703ce4f90"} Jul 28 06:52:11.367752 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.367730 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-9wfk4" event={"ID":"fcd63612-cfa5-441e-9149-bc7d6026553a","Type":"ContainerStarted","Data":"dccd9d074043193c9d2357f48ccd811df140b0426672d356347d2b49a56ad0a3"} Jul 28 06:52:11.375487 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.375442 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-102.ec2.internal" podStartSLOduration=22.375427448 podStartE2EDuration="22.375427448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:10.382419842 +0000 UTC m=+22.725459715" watchObservedRunningTime="2026-07-28 06:52:11.375427448 +0000 UTC m=+23.718467331" Jul 28 06:52:11.375606 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.375506 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-s7xh6" podStartSLOduration=2.509768781 podStartE2EDuration="22.375501697s" totalImagesPullingTime="19.865732916s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:11.375112077 +0000 UTC m=+23.718151958" watchObservedRunningTime="2026-07-28 06:52:11.375501697 +0000 UTC m=+23.718541574" Jul 28 06:52:11.392312 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.392263 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-fgzpd" podStartSLOduration=2.566501689 podStartE2EDuration="22.392245777s" totalImagesPullingTime="19.825744088s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:11.391421594 +0000 UTC m=+23.734461475" watchObservedRunningTime="2026-07-28 06:52:11.392245777 +0000 UTC m=+23.735285659" Jul 28 06:52:11.409836 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.409786 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-9wfk4" podStartSLOduration=2.578789112 podStartE2EDuration="22.409769276s" totalImagesPullingTime="19.830980164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:11.40950969 +0000 UTC m=+23.752549573" watchObservedRunningTime="2026-07-28 06:52:11.409769276 +0000 UTC m=+23.752809157" Jul 28 06:52:11.432187 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.432132 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wl9tg" podStartSLOduration=2.564804944 podStartE2EDuration="22.432116453s" totalImagesPullingTime="19.867311509s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:11.431672899 +0000 UTC m=+23.774712780" watchObservedRunningTime="2026-07-28 06:52:11.432116453 +0000 UTC m=+23.775156334" Jul 28 06:52:11.452730 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.452671 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-sj4wh" podStartSLOduration=2.520450701 podStartE2EDuration="22.45265494s" totalImagesPullingTime="19.932204239s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:11.452031629 +0000 UTC m=+23.795071510" watchObservedRunningTime="2026-07-28 06:52:11.45265494 +0000 UTC m=+23.795694820" Jul 28 06:52:11.663138 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:11.663114 2582 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 06:52:12.070753 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.070648 2582 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T06:52:11.663131991Z","UUID":"1fe82651-d22a-4e92-ba4d-3aef82faf43c","Handler":null,"Name":"","Endpoint":""} Jul 28 06:52:12.072512 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.072489 2582 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 06:52:12.072647 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.072537 2582 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 06:52:12.171123 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.171090 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:12.171368 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:12.171342 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:12.375407 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.375327 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" event={"ID":"d0dbc4da-bdfc-4970-8e0b-46329a594ce9","Type":"ContainerStarted","Data":"c24ed919f0b84b26c8bfa3aac7fe8c1d6cc4c075f858404c9003cd07dbdfcc19"} Jul 28 06:52:12.376949 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.376921 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-9kmk7" event={"ID":"37a1165a-51de-4346-a3e9-3aa2bafb4b1a","Type":"ContainerStarted","Data":"1029ccbc925d07f5724a1f40a5adc4157f4b356c742493e16a2cfa0d8d2951ba"} Jul 28 06:52:12.390981 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:12.390928 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-9kmk7" podStartSLOduration=3.543675786 podStartE2EDuration="23.390910671s" totalImagesPullingTime="19.847234885s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:12.390576868 +0000 UTC m=+24.733616750" watchObservedRunningTime="2026-07-28 06:52:12.390910671 +0000 UTC m=+24.733950552" Jul 28 06:52:13.171719 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:13.171698 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:13.171850 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:13.171702 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:13.171850 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:13.171793 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:13.171942 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:13.171899 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:13.382468 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:13.382424 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" event={"ID":"d0dbc4da-bdfc-4970-8e0b-46329a594ce9","Type":"ContainerStarted","Data":"4a9220381a31d234aab3c0788afdf048a870af1d838ced51a8843c8d0ba5bee6"} Jul 28 06:52:13.386987 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:13.386906 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"48da052b767736afb7f27197e2b427a04da2536211d85fe302fc00686b259930"} Jul 28 06:52:13.402266 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:13.402217 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6khlq" podStartSLOduration=2.358515741 podStartE2EDuration="24.402201086s" totalImagesPullingTime="22.043685345s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:13.402164892 +0000 UTC m=+25.745204775" watchObservedRunningTime="2026-07-28 06:52:13.402201086 +0000 UTC m=+25.745240966" Jul 28 06:52:14.171366 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:14.171136 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:14.171533 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:14.171490 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:15.171596 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:15.171564 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:15.172087 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:15.171564 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:15.172087 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:15.171686 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:15.172087 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:15.171762 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:15.753781 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:15.753757 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:52:15.754679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:15.754659 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:52:16.172355 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.172022 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:16.172988 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:16.172414 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:16.396078 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.396039 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" event={"ID":"450c1e35-14f1-4d48-85b9-34121c7aae86","Type":"ContainerStarted","Data":"59294f6fc68bbb690ad14479e3642275c9d8d0a4099c46c5b30308ea8030f44c"} Jul 28 06:52:16.396356 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.396337 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:16.396476 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.396415 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:16.397967 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.397943 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="2ee27ad530ecebdac7b8bb86d4cc856b903fb8f165c031cffcf857dfafd9702a" exitCode=0 Jul 28 06:52:16.398059 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.398014 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"2ee27ad530ecebdac7b8bb86d4cc856b903fb8f165c031cffcf857dfafd9702a"} Jul 28 06:52:16.398156 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.398137 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:52:16.399217 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.398617 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-9wfk4" Jul 28 06:52:16.412827 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.412803 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:16.426043 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:16.425977 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" podStartSLOduration=7.529615941 podStartE2EDuration="27.425964542s" totalImagesPullingTime="19.896348601s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:16.425636598 +0000 UTC m=+28.768676480" watchObservedRunningTime="2026-07-28 06:52:16.425964542 +0000 UTC m=+28.769004423" Jul 28 06:52:17.171294 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.171264 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:17.171590 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:17.171395 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:17.171590 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.171443 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:17.171590 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:17.171538 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:17.400950 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.400923 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:17.416009 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.415980 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:17.787949 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.787869 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tz9k8"] Jul 28 06:52:17.788161 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.787987 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:17.788161 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:17.788095 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:17.791083 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.791052 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r29hp"] Jul 28 06:52:17.791208 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.791136 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:17.791273 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:17.791246 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:17.793358 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.793338 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rhzj"] Jul 28 06:52:17.793446 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:17.793437 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:17.793562 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:17.793533 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:18.406880 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:18.406843 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="42cf64d0daeb064c957936deda88bfaf97f2e11afb3c67fdf86b9cb9378752f8" exitCode=0 Jul 28 06:52:18.407321 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:18.406935 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"42cf64d0daeb064c957936deda88bfaf97f2e11afb3c67fdf86b9cb9378752f8"} Jul 28 06:52:19.172016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:19.171986 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:19.172016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:19.172001 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:19.172016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:19.172010 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:19.172321 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:19.172120 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:19.172321 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:19.172299 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:19.172428 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:19.172398 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:20.413996 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:20.413740 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="7331834f34df2f302ab45e3d2e987f03286cffbde2271d8faa5add1c22acac54" exitCode=0 Jul 28 06:52:20.413996 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:20.413820 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"7331834f34df2f302ab45e3d2e987f03286cffbde2271d8faa5add1c22acac54"} Jul 28 06:52:21.171760 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.171726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:21.171760 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.171753 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:21.171992 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.171726 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:21.171992 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.171840 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-r29hp" podUID="ebea1bb7-d532-4665-8c84-6b0efc41db93" Jul 28 06:52:21.171992 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.171904 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-tz9k8" podUID="274704ba-e4c7-40b6-81f4-528ab285079b" Jul 28 06:52:21.171992 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.171962 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:52:21.761830 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.761796 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:21.761830 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.761839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.761942 2582 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.761977 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.761999 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret podName:ebea1bb7-d532-4665-8c84-6b0efc41db93 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:53.761985327 +0000 UTC m=+66.105025190 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret") pod "global-pull-secret-syncer-r29hp" (UID: "ebea1bb7-d532-4665-8c84-6b0efc41db93") : object "kube-system"/"original-pull-secret" not registered Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.762000 2582 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.762014 2582 projected.go:196] Error preparing data for projected volume kube-api-access-c6g7r for pod openshift-network-diagnostics/network-check-target-tz9k8: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:21.762363 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.762074 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r podName:274704ba-e4c7-40b6-81f4-528ab285079b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:53.762043847 +0000 UTC m=+66.105083706 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-c6g7r" (UniqueName: "kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r") pod "network-check-target-tz9k8" (UID: "274704ba-e4c7-40b6-81f4-528ab285079b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 06:52:21.862332 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:21.862288 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:21.862524 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.862467 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:21.862589 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:21.862548 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:53.862526482 +0000 UTC m=+66.205566347 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 06:52:22.994975 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:22.994893 2582 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-102.ec2.internal" event="NodeReady" Jul 28 06:52:22.995511 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:22.995046 2582 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 06:52:23.030840 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.030806 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:52:23.032665 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.032649 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.035400 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.035373 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 06:52:23.035523 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.035411 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 06:52:23.035523 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.035413 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ncz9g\"" Jul 28 06:52:23.035751 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.035735 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 06:52:23.040357 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.040336 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 06:52:23.049934 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.049910 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:52:23.053747 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.053720 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-6896n"] Jul 28 06:52:23.056503 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.056481 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-mjmsb"] Jul 28 06:52:23.056618 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.056602 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.058429 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.058397 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.058984 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.058964 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 06:52:23.059217 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.059199 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj4nt\"" Jul 28 06:52:23.059317 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.059232 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 06:52:23.060543 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.060520 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 06:52:23.060666 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.060646 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 06:52:23.060739 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.060646 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 06:52:23.060795 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.060767 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-9z2rj\"" Jul 28 06:52:23.064935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.064881 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjmsb"] Jul 28 06:52:23.065815 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.065742 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6896n"] Jul 28 06:52:23.171534 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171493 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:23.171534 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:23.171534 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171518 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171520 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171610 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171633 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171651 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/336186c1-2f48-40ed-956a-1dbabaca27d6-config-volume\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171714 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171761 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171785 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336186c1-2f48-40ed-956a-1dbabaca27d6-tmp-dir\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.171833 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171811 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171871 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2gkc\" (UniqueName: \"kubernetes.io/projected/336186c1-2f48-40ed-956a-1dbabaca27d6-kube-api-access-s2gkc\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171892 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-cert\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171928 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g8jgh\" (UniqueName: \"kubernetes.io/projected/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-kube-api-access-g8jgh\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.171994 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t7cq4\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.172221 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.172021 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.174229 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174206 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 06:52:23.174371 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174249 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:52:23.174437 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174394 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmd7q\"" Jul 28 06:52:23.174524 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174509 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 06:52:23.174726 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174712 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:52:23.174807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.174778 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mfvlz\"" Jul 28 06:52:23.187721 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.187694 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:23.272450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272371 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272406 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/336186c1-2f48-40ed-956a-1dbabaca27d6-config-volume\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.272693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272539 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272577 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272605 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336186c1-2f48-40ed-956a-1dbabaca27d6-tmp-dir\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.272693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272638 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272679 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272705 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2gkc\" (UniqueName: \"kubernetes.io/projected/336186c1-2f48-40ed-956a-1dbabaca27d6-kube-api-access-s2gkc\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272731 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-cert\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272774 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g8jgh\" (UniqueName: \"kubernetes.io/projected/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-kube-api-access-g8jgh\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272796 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272861 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t7cq4\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272885 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.272935 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272915 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.273243 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.272956 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.273243 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.273067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/336186c1-2f48-40ed-956a-1dbabaca27d6-config-volume\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.273243 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.273119 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.273382 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.273298 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/336186c1-2f48-40ed-956a-1dbabaca27d6-tmp-dir\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.273382 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.273303 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.274378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.273894 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:23.274378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.273972 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:23.773951077 +0000 UTC m=+36.116990955 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:23.274378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.274289 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:23.274378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.274306 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:23.274378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.274353 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:23.774336238 +0000 UTC m=+36.117376104 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:23.274854 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.274834 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.277737 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.277715 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.277841 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.277742 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-cert\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.278087 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.278067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.281052 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.281031 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t7cq4\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.282055 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.282032 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.282372 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.282349 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2gkc\" (UniqueName: \"kubernetes.io/projected/336186c1-2f48-40ed-956a-1dbabaca27d6-kube-api-access-s2gkc\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.282600 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.282581 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g8jgh\" (UniqueName: \"kubernetes.io/projected/2733f84f-ecd7-4ea2-b380-a44cc5cde4ec-kube-api-access-g8jgh\") pod \"ingress-canary-mjmsb\" (UID: \"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec\") " pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.375933 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.375900 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-mjmsb" Jul 28 06:52:23.778400 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.778359 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:23.778577 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:23.778409 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:23.778577 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.778551 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:23.778677 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.778593 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:23.778677 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.778618 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:23.778677 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.778637 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:24.778614322 +0000 UTC m=+37.121654194 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:23.778677 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:23.778662 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:24.778648626 +0000 UTC m=+37.121688484 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:24.716882 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:24.716710 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-mjmsb"] Jul 28 06:52:24.720673 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:52:24.720637 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2733f84f_ecd7_4ea2_b380_a44cc5cde4ec.slice/crio-655aa4c2eb8c6721ef42f376f813f4fa5daff993b1b1a03bf88031b1e2126785 WatchSource:0}: Error finding container 655aa4c2eb8c6721ef42f376f813f4fa5daff993b1b1a03bf88031b1e2126785: Status 404 returned error can't find the container with id 655aa4c2eb8c6721ef42f376f813f4fa5daff993b1b1a03bf88031b1e2126785 Jul 28 06:52:24.785378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:24.785347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:24.785511 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:24.785497 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:24.785573 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:24.785520 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:24.785626 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:24.785577 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:26.785560982 +0000 UTC m=+39.128600861 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:24.785626 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:24.785502 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:24.785626 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:24.785592 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:24.785771 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:24.785642 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:26.785626891 +0000 UTC m=+39.128666773 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:25.430735 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:25.430696 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="dc394075e93c7a88837fa1a35f0d56ea30f1a0761a8d9ce7acda962d07e2d57c" exitCode=0 Jul 28 06:52:25.430907 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:25.430817 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"dc394075e93c7a88837fa1a35f0d56ea30f1a0761a8d9ce7acda962d07e2d57c"} Jul 28 06:52:25.432120 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:25.432058 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjmsb" event={"ID":"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec","Type":"ContainerStarted","Data":"655aa4c2eb8c6721ef42f376f813f4fa5daff993b1b1a03bf88031b1e2126785"} Jul 28 06:52:26.438453 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:26.438414 2582 generic.go:356] "Generic (PLEG): container finished" podID="59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4" containerID="93da228faba1ecf67c046a0b8b816a591d8509a944e29b2ee72b8d391bbcab6d" exitCode=0 Jul 28 06:52:26.438934 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:26.438477 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerDied","Data":"93da228faba1ecf67c046a0b8b816a591d8509a944e29b2ee72b8d391bbcab6d"} Jul 28 06:52:26.801816 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:26.801727 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:26.801816 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:26.801775 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:26.802038 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:26.801904 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:26.802038 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:26.801972 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:30.801953916 +0000 UTC m=+43.144993778 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:26.802038 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:26.801977 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:26.802038 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:26.801999 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:26.802228 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:26.802057 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:30.802038119 +0000 UTC m=+43.145077992 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:27.217721 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:27.217516 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:27.444446 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:27.444404 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-pvqns" event={"ID":"59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4","Type":"ContainerStarted","Data":"3983108ea445df8ae0b86d345f26dae1afa67a0fa426e1096f607f743cd046df"} Jul 28 06:52:27.464949 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:27.464876 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-pvqns" podStartSLOduration=7.935677316 podStartE2EDuration="38.464861991s" totalImagesPullingTime="30.529184675s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:27.463636382 +0000 UTC m=+39.806676263" watchObservedRunningTime="2026-07-28 06:52:27.464861991 +0000 UTC m=+39.807901872" Jul 28 06:52:27.587674 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:27.587631 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:27.640201 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:27.640095 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:28.448438 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:28.448395 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-mjmsb" event={"ID":"2733f84f-ecd7-4ea2-b380-a44cc5cde4ec","Type":"ContainerStarted","Data":"72093970749f0d5f4780b55df1e113f91741a91a4e90634b6cc08a875229f1c8"} Jul 28 06:52:28.463547 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:28.463498 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-mjmsb" podStartSLOduration=2.813700634 podStartE2EDuration="5.46348197s" totalImagesPullingTime="2.649781336s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:28.462316253 +0000 UTC m=+40.805356133" watchObservedRunningTime="2026-07-28 06:52:28.46348197 +0000 UTC m=+40.806521866" Jul 28 06:52:30.218452 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:30.218415 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:30.831034 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:30.830999 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:30.831034 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:30.831037 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:30.831256 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:30.831157 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:30.831256 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:30.831157 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:30.831256 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:30.831238 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:38.831222583 +0000 UTC m=+51.174262441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:30.831360 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:30.831168 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:30.831360 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:30.831301 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:38.831290282 +0000 UTC m=+51.174330140 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:31.737431 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:31.737392 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:31.997840 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:31.997742 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:32.098523 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:32.098479 2582 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" limit=1024 Jul 28 06:52:38.890246 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:38.890208 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:38.890246 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:38.890251 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:38.890763 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:38.890350 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:38.890763 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:38.890350 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:38.890763 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:38.890365 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:38.890763 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:38.890428 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:52:54.890412487 +0000 UTC m=+67.233452346 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:38.890763 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:38.890442 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:52:54.890436353 +0000 UTC m=+67.233476212 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:49.429927 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:49.429896 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-xtlbk" Jul 28 06:52:53.795793 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.795743 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:53.796238 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.795841 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:53.798263 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.798245 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 06:52:53.798636 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.798620 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 06:52:53.808847 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.808821 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 06:52:53.810582 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.810556 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ebea1bb7-d532-4665-8c84-6b0efc41db93-original-pull-secret\") pod \"global-pull-secret-syncer-r29hp\" (UID: \"ebea1bb7-d532-4665-8c84-6b0efc41db93\") " pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:53.818879 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.818850 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6g7r\" (UniqueName: \"kubernetes.io/projected/274704ba-e4c7-40b6-81f4-528ab285079b-kube-api-access-c6g7r\") pod \"network-check-target-tz9k8\" (UID: \"274704ba-e4c7-40b6-81f4-528ab285079b\") " pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:53.897139 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.897091 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:52:53.899730 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:53.899713 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 06:52:53.907850 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:53.907830 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:52:53.907931 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:53.907904 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:53:57.907887959 +0000 UTC m=+130.250927818 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : secret "metrics-daemon-secret" not found Jul 28 06:52:54.094753 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.094665 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-hmd7q\"" Jul 28 06:52:54.096759 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.096743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-r29hp" Jul 28 06:52:54.102227 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.102210 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:54.227089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.227053 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-r29hp"] Jul 28 06:52:54.230971 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:52:54.230945 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebea1bb7_d532_4665_8c84_6b0efc41db93.slice/crio-f15516151590b7c57192c5970a2acb61625ca719fd2388624a3879bc3955ad58 WatchSource:0}: Error finding container f15516151590b7c57192c5970a2acb61625ca719fd2388624a3879bc3955ad58: Status 404 returned error can't find the container with id f15516151590b7c57192c5970a2acb61625ca719fd2388624a3879bc3955ad58 Jul 28 06:52:54.246394 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.246367 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-tz9k8"] Jul 28 06:52:54.249706 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:52:54.249683 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod274704ba_e4c7_40b6_81f4_528ab285079b.slice/crio-c8e9e4d86b75b59f6447b9de533b8e9261ebaef91c97afc0fbcf8988d7ac17e1 WatchSource:0}: Error finding container c8e9e4d86b75b59f6447b9de533b8e9261ebaef91c97afc0fbcf8988d7ac17e1: Status 404 returned error can't find the container with id c8e9e4d86b75b59f6447b9de533b8e9261ebaef91c97afc0fbcf8988d7ac17e1 Jul 28 06:52:54.507918 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.507884 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tz9k8" event={"ID":"274704ba-e4c7-40b6-81f4-528ab285079b","Type":"ContainerStarted","Data":"c8e9e4d86b75b59f6447b9de533b8e9261ebaef91c97afc0fbcf8988d7ac17e1"} Jul 28 06:52:54.508948 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.508923 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r29hp" event={"ID":"ebea1bb7-d532-4665-8c84-6b0efc41db93","Type":"ContainerStarted","Data":"f15516151590b7c57192c5970a2acb61625ca719fd2388624a3879bc3955ad58"} Jul 28 06:52:54.904495 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.904399 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:52:54.904495 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:54.904452 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:52:54.904993 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:54.904572 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:52:54.904993 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:54.904659 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:53:26.904634381 +0000 UTC m=+99.247674243 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:52:54.904993 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:54.904575 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:52:54.904993 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:54.904689 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:52:54.904993 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:52:54.904739 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:53:26.90472829 +0000 UTC m=+99.247768149 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:52:59.523155 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:59.523122 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-tz9k8" event={"ID":"274704ba-e4c7-40b6-81f4-528ab285079b","Type":"ContainerStarted","Data":"4976d72a4e3cf8e1a4f4ab78ecb79bbeb9b0ba5b24d2fa8b0395497f8b70ec98"} Jul 28 06:52:59.523677 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:59.523251 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:52:59.524708 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:59.524688 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-r29hp" event={"ID":"ebea1bb7-d532-4665-8c84-6b0efc41db93","Type":"ContainerStarted","Data":"39eb313c2784a2370d3840348e0e4f23e9cd0910e9a33e61567ebc30fbee16f5"} Jul 28 06:52:59.538981 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:59.538936 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-tz9k8" podStartSLOduration=66.002441374 podStartE2EDuration="1m10.538923165s" totalImagesPullingTime="4.536481791s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:59.538617649 +0000 UTC m=+71.881657530" watchObservedRunningTime="2026-07-28 06:52:59.538923165 +0000 UTC m=+71.881963047" Jul 28 06:52:59.552915 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:52:59.552868 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-r29hp" podStartSLOduration=65.994240901 podStartE2EDuration="1m10.552853934s" totalImagesPullingTime="4.558613033s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:52:59.552286212 +0000 UTC m=+71.895326094" watchObservedRunningTime="2026-07-28 06:52:59.552853934 +0000 UTC m=+71.895893816" Jul 28 06:53:26.950149 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:53:26.949995 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:53:26.950149 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:53:26.950043 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:53:26.950674 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:26.950163 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:53:26.950674 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:26.950250 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:54:30.950232158 +0000 UTC m=+163.293272017 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:53:26.950674 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:26.950166 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:53:26.950674 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:26.950273 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:53:26.950674 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:26.950300 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:54:30.950294237 +0000 UTC m=+163.293334096 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:53:30.529823 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:53:30.529790 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-tz9k8" Jul 28 06:53:57.976683 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:53:57.976640 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:53:57.977113 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:57.976793 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:53:57.977113 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:53:57.976871 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:55:59.976854061 +0000 UTC m=+252.319893922 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : secret "metrics-daemon-secret" not found Jul 28 06:54:26.042988 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:26.042923 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" Jul 28 06:54:26.068216 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:26.068169 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6896n" podUID="336186c1-2f48-40ed-956a-1dbabaca27d6" Jul 28 06:54:26.184090 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:26.184051 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:54:26.728241 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:54:26.728209 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:54:26.728407 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:54:26.728252 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6896n" Jul 28 06:54:31.017841 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:54:31.017802 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:54:31.017845 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:31.017960 2582 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:31.018030 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls podName:336186c1-2f48-40ed-956a-1dbabaca27d6 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:33.018014433 +0000 UTC m=+285.361054292 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls") pod "dns-default-6896n" (UID: "336186c1-2f48-40ed-956a-1dbabaca27d6") : secret "dns-default-metrics-tls" not found Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:31.017963 2582 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:31.018058 2582 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-85dcdc469b-jgzh8: secret "image-registry-tls" not found Jul 28 06:54:31.018250 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:54:31.018106 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls podName:01feb784-588b-4d43-a4bb-a7404d82db2b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:33.018093429 +0000 UTC m=+285.361133289 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls") pod "image-registry-85dcdc469b-jgzh8" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b") : secret "image-registry-tls" not found Jul 28 06:54:39.172025 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:54:39.171919 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:56:00.023897 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:00.023855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:56:00.024437 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:00.024008 2582 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 28 06:56:00.024437 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:00.024085 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs podName:2e0526d0-2279-4ced-b33d-22376dab5808 nodeName:}" failed. No retries permitted until 2026-07-28 06:58:02.024068021 +0000 UTC m=+374.367107884 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs") pod "network-metrics-daemon-5rhzj" (UID: "2e0526d0-2279-4ced-b33d-22376dab5808") : secret "metrics-daemon-secret" not found Jul 28 06:56:10.766897 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.766820 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6"] Jul 28 06:56:10.768464 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.768449 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" Jul 28 06:56:10.771853 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.771832 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-b7wr4\"" Jul 28 06:56:10.778713 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.778686 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx"] Jul 28 06:56:10.780450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.780345 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58"] Jul 28 06:56:10.780587 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.780570 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:10.782053 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.782037 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6"] Jul 28 06:56:10.782131 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.782106 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.784404 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.784383 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 06:56:10.784843 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.784826 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.785205 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.785165 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.785553 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.785533 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-ghwsv\"" Jul 28 06:56:10.787002 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.786964 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 06:56:10.787002 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.786997 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 06:56:10.787166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.786996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.787166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.787086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-rnwbm\"" Jul 28 06:56:10.787319 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.787269 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.795783 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.795759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h297h\" (UniqueName: \"kubernetes.io/projected/ee1d8b9c-5d4d-4140-8730-3108c85ca32d-kube-api-access-h297h\") pod \"network-check-source-7d88cb55d8-k9sp6\" (UID: \"ee1d8b9c-5d4d-4140-8730-3108c85ca32d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" Jul 28 06:56:10.796682 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.796659 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58"] Jul 28 06:56:10.799655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.799634 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx"] Jul 28 06:56:10.869498 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.869461 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm"] Jul 28 06:56:10.871597 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.871555 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk"] Jul 28 06:56:10.871901 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.871697 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.873192 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.873160 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-9b7f58fc7-t2zwc"] Jul 28 06:56:10.873326 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.873259 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:10.875289 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.874509 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.875289 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.874522 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 06:56:10.875289 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.874923 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.875289 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.875088 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 06:56:10.875640 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.875311 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-f79ws\"" Jul 28 06:56:10.876426 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.876321 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-rnxrk\"" Jul 28 06:56:10.876426 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.876409 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 06:56:10.876575 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.876557 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 06:56:10.877762 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.877746 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.880237 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880218 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 06:56:10.880351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880219 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 06:56:10.880473 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880461 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 06:56:10.880690 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880671 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 06:56:10.880757 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880702 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.880757 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880700 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6"] Jul 28 06:56:10.880855 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880840 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-ks2xk\"" Jul 28 06:56:10.880911 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.880842 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.883003 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.882985 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" Jul 28 06:56:10.883660 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.883642 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk"] Jul 28 06:56:10.885519 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.885504 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.885648 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.885624 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-pll45\"" Jul 28 06:56:10.885924 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.885903 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.888998 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.888942 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm"] Jul 28 06:56:10.892466 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.892444 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9b7f58fc7-t2zwc"] Jul 28 06:56:10.894962 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.894942 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6"] Jul 28 06:56:10.896419 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896395 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.896504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896474 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-serving-cert\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.896559 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896505 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h297h\" (UniqueName: \"kubernetes.io/projected/ee1d8b9c-5d4d-4140-8730-3108c85ca32d-kube-api-access-h297h\") pod \"network-check-source-7d88cb55d8-k9sp6\" (UID: \"ee1d8b9c-5d4d-4140-8730-3108c85ca32d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" Jul 28 06:56:10.896559 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896532 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8d86\" (UniqueName: \"kubernetes.io/projected/1f00d38c-33fc-41bc-8019-e857aab46132-kube-api-access-b8d86\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.896666 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896576 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f00d38c-33fc-41bc-8019-e857aab46132-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.896759 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896738 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnpdb\" (UniqueName: \"kubernetes.io/projected/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-kube-api-access-cnpdb\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.896829 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896784 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2226b4c-4e2a-46bf-8488-1366bf0190f1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:10.896886 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896859 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:10.896951 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:10.897013 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.896985 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-config\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.897137 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.897025 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dpsm\" (UniqueName: \"kubernetes.io/projected/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-kube-api-access-5dpsm\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:10.910095 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.910071 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h297h\" (UniqueName: \"kubernetes.io/projected/ee1d8b9c-5d4d-4140-8730-3108c85ca32d-kube-api-access-h297h\") pod \"network-check-source-7d88cb55d8-k9sp6\" (UID: \"ee1d8b9c-5d4d-4140-8730-3108c85ca32d\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" Jul 28 06:56:10.960533 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.960507 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh"] Jul 28 06:56:10.962394 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.962380 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:10.964740 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.964720 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 06:56:10.964851 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.964739 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:56:10.964851 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.964787 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 06:56:10.964968 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.964852 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tgr5r\"" Jul 28 06:56:10.965022 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.965004 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 06:56:10.973365 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.973343 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh"] Jul 28 06:56:10.997655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997623 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74qmh\" (UniqueName: \"kubernetes.io/projected/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-kube-api-access-74qmh\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.997797 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997665 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-config\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.997860 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997795 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.997860 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997823 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:10.997860 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997846 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f42843f-843b-4aa4-b2f1-d73766624a7a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997868 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnpdb\" (UniqueName: \"kubernetes.io/projected/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-kube-api-access-cnpdb\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997898 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-stats-auth\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.997930 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.997951 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.997963 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8d86\" (UniqueName: \"kubernetes.io/projected/1f00d38c-33fc-41bc-8019-e857aab46132-kube-api-access-b8d86\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.997990 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:11.497970224 +0000 UTC m=+263.841010093 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:10.998016 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.998013 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:11.498003703 +0000 UTC m=+263.841043562 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998041 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f42843f-843b-4aa4-b2f1-d73766624a7a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998068 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998098 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-serving-cert\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998123 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgwkj\" (UniqueName: \"kubernetes.io/projected/c00e8859-9778-4263-9865-4897277dcda5-kube-api-access-fgwkj\") pod \"volume-data-source-validator-549c6d54cf-p26h6\" (UID: \"c00e8859-9778-4263-9865-4897277dcda5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998151 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dpsm\" (UniqueName: \"kubernetes.io/projected/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-kube-api-access-5dpsm\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.998164 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998204 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:10.998231 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls podName:03bbf5fd-41d5-40d4-9a6c-4e86af3f4195 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:11.498214459 +0000 UTC m=+263.841254322 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls") pod "cluster-samples-operator-6748489656-72mwx" (UID: "03bbf5fd-41d5-40d4-9a6c-4e86af3f4195") : secret "samples-operator-tls" not found Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998285 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-config\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998300 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998336 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f00d38c-33fc-41bc-8019-e857aab46132-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.998378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998361 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2226b4c-4e2a-46bf-8488-1366bf0190f1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:10.998794 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998390 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-default-certificate\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:10.998794 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.998406 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wp5h7\" (UniqueName: \"kubernetes.io/projected/3f42843f-843b-4aa4-b2f1-d73766624a7a-kube-api-access-wp5h7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:10.999050 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.999031 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/1f00d38c-33fc-41bc-8019-e857aab46132-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:10.999083 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:10.999031 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/d2226b4c-4e2a-46bf-8488-1366bf0190f1-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:11.000434 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.000419 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-serving-cert\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:11.008068 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.008047 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnpdb\" (UniqueName: \"kubernetes.io/projected/b9d848e8-a2d5-4d59-9e3d-89e75ec49d16-kube-api-access-cnpdb\") pod \"service-ca-operator-5d6c75f84f-22xnm\" (UID: \"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:11.008524 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.008506 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8d86\" (UniqueName: \"kubernetes.io/projected/1f00d38c-33fc-41bc-8019-e857aab46132-kube-api-access-b8d86\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:11.008599 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.008532 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dpsm\" (UniqueName: \"kubernetes.io/projected/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-kube-api-access-5dpsm\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:11.076639 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.076546 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" Jul 28 06:56:11.099394 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099368 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f42843f-843b-4aa4-b2f1-d73766624a7a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099411 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgwkj\" (UniqueName: \"kubernetes.io/projected/c00e8859-9778-4263-9865-4897277dcda5-kube-api-access-fgwkj\") pod \"volume-data-source-validator-549c6d54cf-p26h6\" (UID: \"c00e8859-9778-4263-9865-4897277dcda5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099439 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099479 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099501 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-default-certificate\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099517 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wp5h7\" (UniqueName: \"kubernetes.io/projected/3f42843f-843b-4aa4-b2f1-d73766624a7a-kube-api-access-wp5h7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.099552 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099546 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74qmh\" (UniqueName: \"kubernetes.io/projected/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-kube-api-access-74qmh\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.099822 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.099627 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:11.099822 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.099685 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:11.59964737 +0000 UTC m=+263.942687229 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:11.099822 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.099714 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:11.59970284 +0000 UTC m=+263.942742703 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:11.099822 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099779 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f42843f-843b-4aa4-b2f1-d73766624a7a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.099822 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.099813 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-stats-auth\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.100679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.100656 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3f42843f-843b-4aa4-b2f1-d73766624a7a-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.101896 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.101875 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3f42843f-843b-4aa4-b2f1-d73766624a7a-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.102295 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.102280 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-default-certificate\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.102874 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.102857 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-stats-auth\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.108551 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.108523 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74qmh\" (UniqueName: \"kubernetes.io/projected/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-kube-api-access-74qmh\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.109212 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.109165 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wp5h7\" (UniqueName: \"kubernetes.io/projected/3f42843f-843b-4aa4-b2f1-d73766624a7a-kube-api-access-wp5h7\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh\" (UID: \"3f42843f-843b-4aa4-b2f1-d73766624a7a\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.109770 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.109749 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgwkj\" (UniqueName: \"kubernetes.io/projected/c00e8859-9778-4263-9865-4897277dcda5-kube-api-access-fgwkj\") pod \"volume-data-source-validator-549c6d54cf-p26h6\" (UID: \"c00e8859-9778-4263-9865-4897277dcda5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" Jul 28 06:56:11.184756 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.184727 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" Jul 28 06:56:11.197790 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.197763 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6"] Jul 28 06:56:11.200547 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:11.200523 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podee1d8b9c_5d4d_4140_8730_3108c85ca32d.slice/crio-37e59ddc96d5fa3227e1d933c706a4d22d157e38e3cb3cc4a546ea43f8aa84c9 WatchSource:0}: Error finding container 37e59ddc96d5fa3227e1d933c706a4d22d157e38e3cb3cc4a546ea43f8aa84c9: Status 404 returned error can't find the container with id 37e59ddc96d5fa3227e1d933c706a4d22d157e38e3cb3cc4a546ea43f8aa84c9 Jul 28 06:56:11.205006 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.204981 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" Jul 28 06:56:11.271702 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.271495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" Jul 28 06:56:11.333554 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.333510 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm"] Jul 28 06:56:11.338357 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:11.338096 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9d848e8_a2d5_4d59_9e3d_89e75ec49d16.slice/crio-eb222511badbcfada31ef15d5e507b7131b85578ec4debbe600e3d730f5db51b WatchSource:0}: Error finding container eb222511badbcfada31ef15d5e507b7131b85578ec4debbe600e3d730f5db51b: Status 404 returned error can't find the container with id eb222511badbcfada31ef15d5e507b7131b85578ec4debbe600e3d730f5db51b Jul 28 06:56:11.353079 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.353049 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6"] Jul 28 06:56:11.356589 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:11.356563 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc00e8859_9778_4263_9865_4897277dcda5.slice/crio-5c3f48664c635f0836ebf1d9eb28d6674617be9e09b4ae3c7cf86eca8d4ec3bc WatchSource:0}: Error finding container 5c3f48664c635f0836ebf1d9eb28d6674617be9e09b4ae3c7cf86eca8d4ec3bc: Status 404 returned error can't find the container with id 5c3f48664c635f0836ebf1d9eb28d6674617be9e09b4ae3c7cf86eca8d4ec3bc Jul 28 06:56:11.412807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.412758 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh"] Jul 28 06:56:11.416973 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:11.416937 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f42843f_843b_4aa4_b2f1_d73766624a7a.slice/crio-375e4d3704de269565b73c8b8f3a69c87ad3cd078b3253e329a602997d74c8d5 WatchSource:0}: Error finding container 375e4d3704de269565b73c8b8f3a69c87ad3cd078b3253e329a602997d74c8d5: Status 404 returned error can't find the container with id 375e4d3704de269565b73c8b8f3a69c87ad3cd078b3253e329a602997d74c8d5 Jul 28 06:56:11.503344 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.503304 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:11.503344 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.503347 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.503392 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503449 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503509 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:12.503493452 +0000 UTC m=+264.846533311 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503523 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503549 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503579 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:12.503563912 +0000 UTC m=+264.846603771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:11.503599 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.503599 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls podName:03bbf5fd-41d5-40d4-9a6c-4e86af3f4195 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:12.503585923 +0000 UTC m=+264.846625785 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls") pod "cluster-samples-operator-6748489656-72mwx" (UID: "03bbf5fd-41d5-40d4-9a6c-4e86af3f4195") : secret "samples-operator-tls" not found Jul 28 06:56:11.604526 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.604446 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.604526 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.604507 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:11.604709 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.604620 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:11.604709 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.604701 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:12.604678907 +0000 UTC m=+264.947718769 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:11.604792 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:11.604719 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:12.604710002 +0000 UTC m=+264.947749864 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:11.971696 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.971565 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" event={"ID":"3f42843f-843b-4aa4-b2f1-d73766624a7a","Type":"ContainerStarted","Data":"375e4d3704de269565b73c8b8f3a69c87ad3cd078b3253e329a602997d74c8d5"} Jul 28 06:56:11.974912 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.974874 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" event={"ID":"ee1d8b9c-5d4d-4140-8730-3108c85ca32d","Type":"ContainerStarted","Data":"fddee280dd13b70a598fb0875e396117f8b27a000040155bd2800598c7f849f6"} Jul 28 06:56:11.975062 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.974919 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" event={"ID":"ee1d8b9c-5d4d-4140-8730-3108c85ca32d","Type":"ContainerStarted","Data":"37e59ddc96d5fa3227e1d933c706a4d22d157e38e3cb3cc4a546ea43f8aa84c9"} Jul 28 06:56:11.976591 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.976524 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" event={"ID":"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16","Type":"ContainerStarted","Data":"eb222511badbcfada31ef15d5e507b7131b85578ec4debbe600e3d730f5db51b"} Jul 28 06:56:11.979309 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:11.979284 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" event={"ID":"c00e8859-9778-4263-9865-4897277dcda5","Type":"ContainerStarted","Data":"5c3f48664c635f0836ebf1d9eb28d6674617be9e09b4ae3c7cf86eca8d4ec3bc"} Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.514243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.514298 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.514352 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514426 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514484 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:12.514522 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514492 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:14.51447359 +0000 UTC m=+266.857513452 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:12.514976 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514551 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:14.514533298 +0000 UTC m=+266.857573160 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:12.514976 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514483 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:56:12.514976 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.514589 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls podName:03bbf5fd-41d5-40d4-9a6c-4e86af3f4195 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:14.514579841 +0000 UTC m=+266.857619700 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls") pod "cluster-samples-operator-6748489656-72mwx" (UID: "03bbf5fd-41d5-40d4-9a6c-4e86af3f4195") : secret "samples-operator-tls" not found Jul 28 06:56:12.615074 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.614927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:12.615074 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.615012 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:12.615074 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.615048 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:12.615462 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.615115 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:14.615097194 +0000 UTC m=+266.958137054 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:12.615462 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:12.615139 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:14.615121935 +0000 UTC m=+266.958161798 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:12.985045 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:12.984968 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" event={"ID":"c00e8859-9778-4263-9865-4897277dcda5","Type":"ContainerStarted","Data":"9c2b071a2091781b2c1dffad2f42b197d5dc8e7f435d4d39813346b6b777c788"} Jul 28 06:56:13.000566 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:13.000502 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-k9sp6" podStartSLOduration=3.00048164 podStartE2EDuration="3.00048164s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:11.991319661 +0000 UTC m=+264.334359543" watchObservedRunningTime="2026-07-28 06:56:13.00048164 +0000 UTC m=+265.343521525" Jul 28 06:56:13.000746 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:13.000668 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-p26h6" podStartSLOduration=1.613365425 podStartE2EDuration="3.000658718s" totalImagesPullingTime="1.387293293s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:12.999597269 +0000 UTC m=+265.342637148" watchObservedRunningTime="2026-07-28 06:56:13.000658718 +0000 UTC m=+265.343698599" Jul 28 06:56:13.989804 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:13.989775 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" event={"ID":"3f42843f-843b-4aa4-b2f1-d73766624a7a","Type":"ContainerStarted","Data":"bd8e0ec98609b771cc2a33818304cd4b82669c7b3e1e3f6daca7812d1962045a"} Jul 28 06:56:13.991450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:13.991421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" event={"ID":"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16","Type":"ContainerStarted","Data":"0d437089c96e32f60a056bd7ea3505fff9b8f7bded8f7e9ff9e575778e2066a0"} Jul 28 06:56:14.007392 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.007345 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" podStartSLOduration=1.421448079 podStartE2EDuration="4.007328053s" totalImagesPullingTime="2.585879974s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:14.00643835 +0000 UTC m=+266.349478235" watchObservedRunningTime="2026-07-28 06:56:14.007328053 +0000 UTC m=+266.350367933" Jul 28 06:56:14.449310 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.449280 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-nmp6x"] Jul 28 06:56:14.451439 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.451423 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.456020 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.455988 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-6w47n\"" Jul 28 06:56:14.456020 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.456002 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 06:56:14.456227 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.456023 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 06:56:14.456227 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.456076 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 06:56:14.456354 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.456327 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 06:56:14.477635 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.477608 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmp6x"] Jul 28 06:56:14.533142 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533104 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533150 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533203 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533239 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-crio-socket\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533269 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-data-volume\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533274 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533298 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s42cr\" (UniqueName: \"kubernetes.io/projected/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-api-access-s42cr\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.533348 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533351 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.533321002 +0000 UTC m=+270.876360875 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533362 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533378 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533429 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.533411648 +0000 UTC m=+270.876451510 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533453 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.533464 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.533682 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.533494 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls podName:03bbf5fd-41d5-40d4-9a6c-4e86af3f4195 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.533481629 +0000 UTC m=+270.876521494 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls") pod "cluster-samples-operator-6748489656-72mwx" (UID: "03bbf5fd-41d5-40d4-9a6c-4e86af3f4195") : secret "samples-operator-tls" not found Jul 28 06:56:14.634928 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.634890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:14.634928 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.634930 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.634989 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635061 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635108 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635136 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.635118623 +0000 UTC m=+270.978158484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635160 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:15.135150099 +0000 UTC m=+267.478189962 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:14.635203 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635197 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.635178969 +0000 UTC m=+270.978218841 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635243 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635272 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-crio-socket\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635301 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-data-volume\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635324 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s42cr\" (UniqueName: \"kubernetes.io/projected/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-api-access-s42cr\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635358 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635374 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-crio-socket\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.635472 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:14.635407 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:15.135391547 +0000 UTC m=+267.478431412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : configmap "kube-rbac-proxy" not found Jul 28 06:56:14.635670 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.635650 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-data-volume\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:14.643353 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:14.643323 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s42cr\" (UniqueName: \"kubernetes.io/projected/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-api-access-s42cr\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:15.013113 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:15.013052 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" podStartSLOduration=2.507320252 podStartE2EDuration="5.013030851s" totalImagesPullingTime="2.505710599s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:15.012838308 +0000 UTC m=+267.355878194" watchObservedRunningTime="2026-07-28 06:56:15.013030851 +0000 UTC m=+267.356070734" Jul 28 06:56:15.140851 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:15.140810 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:15.141034 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:15.140954 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:15.141034 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:15.140979 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:15.141034 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:15.141020 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:16.14100433 +0000 UTC m=+268.484044189 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:15.141151 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:15.141055 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:15.141151 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:15.141108 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:16.141092964 +0000 UTC m=+268.484132828 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : configmap "kube-rbac-proxy" not found Jul 28 06:56:16.153295 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.153255 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:16.153752 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.153329 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:16.153752 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:16.153400 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:16.153752 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:16.153465 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:16.153752 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:16.153486 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.153464371 +0000 UTC m=+270.496504233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : configmap "kube-rbac-proxy" not found Jul 28 06:56:16.153752 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:16.153508 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:18.153496128 +0000 UTC m=+270.496535990 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:16.257317 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.257289 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fgzpd_f1c34b94-f4b9-4c33-8535-5acb369ef0cf/dns-node-resolver/0.log" Jul 28 06:56:16.385996 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.385961 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8"] Jul 28 06:56:16.388020 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.388004 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" Jul 28 06:56:16.390642 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.390619 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 06:56:16.390642 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.390632 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 06:56:16.391681 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.391660 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-49jbt\"" Jul 28 06:56:16.398166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.398134 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8"] Jul 28 06:56:16.455820 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.455736 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8l9b4\" (UniqueName: \"kubernetes.io/projected/4dbb63cc-c115-4522-bd50-126d35152d50-kube-api-access-8l9b4\") pod \"migrator-6865c9967-dtjz8\" (UID: \"4dbb63cc-c115-4522-bd50-126d35152d50\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" Jul 28 06:56:16.556717 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.556686 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8l9b4\" (UniqueName: \"kubernetes.io/projected/4dbb63cc-c115-4522-bd50-126d35152d50-kube-api-access-8l9b4\") pod \"migrator-6865c9967-dtjz8\" (UID: \"4dbb63cc-c115-4522-bd50-126d35152d50\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" Jul 28 06:56:16.564276 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.564259 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8l9b4\" (UniqueName: \"kubernetes.io/projected/4dbb63cc-c115-4522-bd50-126d35152d50-kube-api-access-8l9b4\") pod \"migrator-6865c9967-dtjz8\" (UID: \"4dbb63cc-c115-4522-bd50-126d35152d50\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" Jul 28 06:56:16.698485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.698436 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" Jul 28 06:56:16.821383 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:16.821358 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8"] Jul 28 06:56:16.823779 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:16.823749 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4dbb63cc_c115_4522_bd50_126d35152d50.slice/crio-bbb5465b41913a67c1d2e4fd00f19c35b6e0a0095a6c6d91c88e485b9b8fe2eb WatchSource:0}: Error finding container bbb5465b41913a67c1d2e4fd00f19c35b6e0a0095a6c6d91c88e485b9b8fe2eb: Status 404 returned error can't find the container with id bbb5465b41913a67c1d2e4fd00f19c35b6e0a0095a6c6d91c88e485b9b8fe2eb Jul 28 06:56:17.003325 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:17.003293 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" event={"ID":"4dbb63cc-c115-4522-bd50-126d35152d50","Type":"ContainerStarted","Data":"bbb5465b41913a67c1d2e4fd00f19c35b6e0a0095a6c6d91c88e485b9b8fe2eb"} Jul 28 06:56:17.656250 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:17.656225 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wl9tg_6b41361a-8b8b-4c72-9141-f21158c72f09/node-ca/0.log" Jul 28 06:56:18.007998 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.007962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" event={"ID":"4dbb63cc-c115-4522-bd50-126d35152d50","Type":"ContainerStarted","Data":"d0569e35d1bf4863e8c1d11a18a13c339d130bb687195614cd05e0897af78486"} Jul 28 06:56:18.008150 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.008019 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" event={"ID":"4dbb63cc-c115-4522-bd50-126d35152d50","Type":"ContainerStarted","Data":"9d5405b14b1e45c4ed0736b63cedf169d098d32c457f38df74758011faac9337"} Jul 28 06:56:18.022819 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.022769 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-dtjz8" podStartSLOduration=1.045674064 podStartE2EDuration="2.022754244s" totalImagesPullingTime="977.08018ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:18.021895829 +0000 UTC m=+270.364935710" watchObservedRunningTime="2026-07-28 06:56:18.022754244 +0000 UTC m=+270.365794115" Jul 28 06:56:18.057299 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.057274 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjmsb_2733f84f-ecd7-4ea2-b380-a44cc5cde4ec/serve-healthcheck-canary/0.log" Jul 28 06:56:18.171297 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.171202 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:18.171463 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.171306 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:18.171463 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.171313 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:18.171463 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.171381 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:22.171360395 +0000 UTC m=+274.514400256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : configmap "kube-rbac-proxy" not found Jul 28 06:56:18.171463 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.171407 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:18.171463 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.171465 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:22.171449459 +0000 UTC m=+274.514489341 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:18.574792 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.574755 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:18.574961 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.574851 2582 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 06:56:18.574961 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.574880 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:18.574961 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.574908 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls podName:03bbf5fd-41d5-40d4-9a6c-4e86af3f4195 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:26.574893064 +0000 UTC m=+278.917932923 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls") pod "cluster-samples-operator-6748489656-72mwx" (UID: "03bbf5fd-41d5-40d4-9a6c-4e86af3f4195") : secret "samples-operator-tls" not found Jul 28 06:56:18.574961 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.574926 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:18.574961 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.574957 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:18.575116 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.575003 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:26.574989371 +0000 UTC m=+278.918029229 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:18.575116 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.575029 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:18.575116 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.575061 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:26.575053618 +0000 UTC m=+278.918093477 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:18.675443 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.675388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:18.675836 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:18.675483 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:18.675836 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.675540 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:18.675836 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.675617 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:26.675600063 +0000 UTC m=+279.018639925 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:18.675836 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:18.675640 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:26.675625388 +0000 UTC m=+279.018665247 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:22.206991 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:22.206937 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:22.207435 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:22.207033 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:22.207435 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:22.207064 2582 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 06:56:22.207435 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:22.207123 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:30.207106577 +0000 UTC m=+282.550146436 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : configmap "kube-rbac-proxy" not found Jul 28 06:56:22.207435 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:22.207188 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:22.207435 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:22.207237 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:30.207225464 +0000 UTC m=+282.550265325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:26.644568 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.644530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:26.644568 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.644571 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:26.644966 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.644611 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:26.644966 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.644675 2582 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:26.644966 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.644732 2582 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 06:56:26.644966 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.644756 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls podName:1f00d38c-33fc-41bc-8019-e857aab46132 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:42.644737635 +0000 UTC m=+294.987777496 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-6wq58" (UID: "1f00d38c-33fc-41bc-8019-e857aab46132") : secret "cluster-monitoring-operator-tls" not found Jul 28 06:56:26.644966 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.644793 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert podName:d2226b4c-4e2a-46bf-8488-1366bf0190f1 nodeName:}" failed. No retries permitted until 2026-07-28 06:56:42.64477649 +0000 UTC m=+294.987816349 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-fd5lk" (UID: "d2226b4c-4e2a-46bf-8488-1366bf0190f1") : secret "networking-console-plugin-cert" not found Jul 28 06:56:26.647213 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.647193 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/03bbf5fd-41d5-40d4-9a6c-4e86af3f4195-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-72mwx\" (UID: \"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:26.690824 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.690786 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" Jul 28 06:56:26.745386 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.745356 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:26.745525 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.745504 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:26.745587 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.745533 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:42.745510527 +0000 UTC m=+295.088550388 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : configmap references non-existent config key: service-ca.crt Jul 28 06:56:26.745654 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.745586 2582 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 06:56:26.745654 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:26.745635 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs podName:d11413a3-5eb8-4924-b16f-a95a6bc64cdb nodeName:}" failed. No retries permitted until 2026-07-28 06:56:42.745625854 +0000 UTC m=+295.088665713 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs") pod "router-default-9b7f58fc7-t2zwc" (UID: "d11413a3-5eb8-4924-b16f-a95a6bc64cdb") : secret "router-metrics-certs-default" not found Jul 28 06:56:26.813450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:26.813424 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx"] Jul 28 06:56:27.034038 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:27.034000 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" event={"ID":"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195","Type":"ContainerStarted","Data":"ac3f292f764d425c7c5b3db9208bc8993ad19ae058685aa10cc6646d13a83d3c"} Jul 28 06:56:29.044637 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:29.044601 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" event={"ID":"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195","Type":"ContainerStarted","Data":"792b9d2611d9c71e472f66975ad31af65edc0409c3bdd8e187e8e3d9829f6ed2"} Jul 28 06:56:29.045000 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:29.044654 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" event={"ID":"03bbf5fd-41d5-40d4-9a6c-4e86af3f4195","Type":"ContainerStarted","Data":"dead5b642224199d2b1649b7d7690bec4e43daf449d52be4d409e5a7e99d5a19"} Jul 28 06:56:29.060723 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:29.060668 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-72mwx" podStartSLOduration=17.197372184 podStartE2EDuration="19.060652995s" totalImagesPullingTime="1.863280811s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:29.059299556 +0000 UTC m=+281.402339436" watchObservedRunningTime="2026-07-28 06:56:29.060652995 +0000 UTC m=+281.403692875" Jul 28 06:56:29.729090 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:29.729046 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-6896n" podUID="336186c1-2f48-40ed-956a-1dbabaca27d6" Jul 28 06:56:29.729290 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:29.729046 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" Jul 28 06:56:30.047744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:30.047713 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:30.047744 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:30.047732 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6896n" Jul 28 06:56:30.276128 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:30.276090 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:30.276362 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:30.276171 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:30.276362 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:30.276319 2582 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 06:56:30.276430 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:30.276385 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls podName:ff03eec4-47e3-4c52-b831-d9ec4233bc9b nodeName:}" failed. No retries permitted until 2026-07-28 06:56:46.27636891 +0000 UTC m=+298.619408768 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-nmp6x" (UID: "ff03eec4-47e3-4c52-b831-d9ec4233bc9b") : secret "insights-runtime-extractor-tls" not found Jul 28 06:56:30.276637 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:30.276620 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:33.102765 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.102732 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:33.103254 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.102787 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:56:33.105218 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.105195 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/336186c1-2f48-40ed-956a-1dbabaca27d6-metrics-tls\") pod \"dns-default-6896n\" (UID: \"336186c1-2f48-40ed-956a-1dbabaca27d6\") " pod="openshift-dns/dns-default-6896n" Jul 28 06:56:33.105324 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.105217 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"image-registry-85dcdc469b-jgzh8\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:33.352504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.352474 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-ncz9g\"" Jul 28 06:56:33.352504 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.352475 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-xj4nt\"" Jul 28 06:56:33.359585 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.359529 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:33.359654 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.359630 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-6896n" Jul 28 06:56:33.498266 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.498237 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:56:33.501322 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:33.501298 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01feb784_588b_4d43_a4bb_a7404d82db2b.slice/crio-db546c40b8352c1875788ce6449edd7116f3159af71ffad422821b6e9f60b1de WatchSource:0}: Error finding container db546c40b8352c1875788ce6449edd7116f3159af71ffad422821b6e9f60b1de: Status 404 returned error can't find the container with id db546c40b8352c1875788ce6449edd7116f3159af71ffad422821b6e9f60b1de Jul 28 06:56:33.511545 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:33.511517 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-6896n"] Jul 28 06:56:33.515631 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:33.515595 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod336186c1_2f48_40ed_956a_1dbabaca27d6.slice/crio-1a93f6a19cb83009c832166b72d006b48cffcd10fff5315fed2cfeadd21a4ba1 WatchSource:0}: Error finding container 1a93f6a19cb83009c832166b72d006b48cffcd10fff5315fed2cfeadd21a4ba1: Status 404 returned error can't find the container with id 1a93f6a19cb83009c832166b72d006b48cffcd10fff5315fed2cfeadd21a4ba1 Jul 28 06:56:34.060880 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:34.060841 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6896n" event={"ID":"336186c1-2f48-40ed-956a-1dbabaca27d6","Type":"ContainerStarted","Data":"1a93f6a19cb83009c832166b72d006b48cffcd10fff5315fed2cfeadd21a4ba1"} Jul 28 06:56:34.062529 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:34.062496 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" event={"ID":"01feb784-588b-4d43-a4bb-a7404d82db2b","Type":"ContainerStarted","Data":"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d"} Jul 28 06:56:34.062741 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:34.062548 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" event={"ID":"01feb784-588b-4d43-a4bb-a7404d82db2b","Type":"ContainerStarted","Data":"db546c40b8352c1875788ce6449edd7116f3159af71ffad422821b6e9f60b1de"} Jul 28 06:56:34.062741 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:34.062649 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:34.083953 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:34.083898 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" podStartSLOduration=285.083877754 podStartE2EDuration="4m45.083877754s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:34.083547317 +0000 UTC m=+286.426587213" watchObservedRunningTime="2026-07-28 06:56:34.083877754 +0000 UTC m=+286.426917639" Jul 28 06:56:36.071047 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:36.071009 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6896n" event={"ID":"336186c1-2f48-40ed-956a-1dbabaca27d6","Type":"ContainerStarted","Data":"171ebffe79445cac7543d77d6c6795e2e948ef257c8ce5e02898e53b916e1a97"} Jul 28 06:56:36.071472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:36.071068 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-6896n" event={"ID":"336186c1-2f48-40ed-956a-1dbabaca27d6","Type":"ContainerStarted","Data":"71dd67e31d55a5ec970429d54fb376a52c8d40914eb42f03d1ed11991a479ba9"} Jul 28 06:56:36.071472 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:36.071118 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-6896n" Jul 28 06:56:36.088485 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:36.088436 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-6896n" podStartSLOduration=251.358639496 podStartE2EDuration="4m13.088420213s" totalImagesPullingTime="1.729780717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:52:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:36.087266717 +0000 UTC m=+288.430306599" watchObservedRunningTime="2026-07-28 06:56:36.088420213 +0000 UTC m=+288.431460094" Jul 28 06:56:42.172711 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:56:42.172670 2582 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-5rhzj" podUID="2e0526d0-2279-4ced-b33d-22376dab5808" Jul 28 06:56:42.683776 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.683742 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:42.683776 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.683780 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:42.686332 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.686306 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/d2226b4c-4e2a-46bf-8488-1366bf0190f1-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-fd5lk\" (UID: \"d2226b4c-4e2a-46bf-8488-1366bf0190f1\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:42.686450 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.686401 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/1f00d38c-33fc-41bc-8019-e857aab46132-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-6wq58\" (UID: \"1f00d38c-33fc-41bc-8019-e857aab46132\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:42.693301 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.693279 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" Jul 28 06:56:42.784810 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.784779 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:42.784960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.784837 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:42.785409 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.785391 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-service-ca-bundle\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:42.787475 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.787448 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/d11413a3-5eb8-4924-b16f-a95a6bc64cdb-metrics-certs\") pod \"router-default-9b7f58fc7-t2zwc\" (UID: \"d11413a3-5eb8-4924-b16f-a95a6bc64cdb\") " pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:42.821928 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.821896 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk"] Jul 28 06:56:42.824895 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:42.824869 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd2226b4c_4e2a_46bf_8488_1366bf0190f1.slice/crio-97386b7f9ebedae3e50f659ca16109087c6da73cc53f8407643a220bed556d6b WatchSource:0}: Error finding container 97386b7f9ebedae3e50f659ca16109087c6da73cc53f8407643a220bed556d6b: Status 404 returned error can't find the container with id 97386b7f9ebedae3e50f659ca16109087c6da73cc53f8407643a220bed556d6b Jul 28 06:56:42.895604 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:42.895565 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" Jul 28 06:56:43.000845 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:43.000816 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:43.021619 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:43.021586 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58"] Jul 28 06:56:43.025192 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:43.025151 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f00d38c_33fc_41bc_8019_e857aab46132.slice/crio-fe644b1797ac14a7fa6c094ccead86df539393d51cc6bec108ccca7683931a29 WatchSource:0}: Error finding container fe644b1797ac14a7fa6c094ccead86df539393d51cc6bec108ccca7683931a29: Status 404 returned error can't find the container with id fe644b1797ac14a7fa6c094ccead86df539393d51cc6bec108ccca7683931a29 Jul 28 06:56:43.097397 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:43.097300 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" event={"ID":"d2226b4c-4e2a-46bf-8488-1366bf0190f1","Type":"ContainerStarted","Data":"97386b7f9ebedae3e50f659ca16109087c6da73cc53f8407643a220bed556d6b"} Jul 28 06:56:43.098605 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:43.098575 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" event={"ID":"1f00d38c-33fc-41bc-8019-e857aab46132","Type":"ContainerStarted","Data":"fe644b1797ac14a7fa6c094ccead86df539393d51cc6bec108ccca7683931a29"} Jul 28 06:56:43.132668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:43.132640 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-9b7f58fc7-t2zwc"] Jul 28 06:56:43.135213 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:43.135169 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd11413a3_5eb8_4924_b16f_a95a6bc64cdb.slice/crio-a7a3ea82cc6bd575410cb271557a4a291491f1299f491a708054eb6e926ce255 WatchSource:0}: Error finding container a7a3ea82cc6bd575410cb271557a4a291491f1299f491a708054eb6e926ce255: Status 404 returned error can't find the container with id a7a3ea82cc6bd575410cb271557a4a291491f1299f491a708054eb6e926ce255 Jul 28 06:56:44.104426 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:44.104328 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" event={"ID":"d2226b4c-4e2a-46bf-8488-1366bf0190f1","Type":"ContainerStarted","Data":"d718ddeb647310e59d06d765a8393fb12ca0caac6a3880db291f437019efef40"} Jul 28 06:56:44.105993 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:44.105962 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" event={"ID":"d11413a3-5eb8-4924-b16f-a95a6bc64cdb","Type":"ContainerStarted","Data":"27350ada615a6bfec62f7bb281759cd365851f032151eada4c8b4671cb996f02"} Jul 28 06:56:44.106110 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:44.106005 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" event={"ID":"d11413a3-5eb8-4924-b16f-a95a6bc64cdb","Type":"ContainerStarted","Data":"a7a3ea82cc6bd575410cb271557a4a291491f1299f491a708054eb6e926ce255"} Jul 28 06:56:44.119622 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:44.119550 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-fd5lk" podStartSLOduration=33.095511972 podStartE2EDuration="34.11953025s" totalImagesPullingTime="1.024018278s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:44.119483323 +0000 UTC m=+296.462523205" watchObservedRunningTime="2026-07-28 06:56:44.11953025 +0000 UTC m=+296.462570180" Jul 28 06:56:44.143294 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:44.143248 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" podStartSLOduration=34.143232869 podStartE2EDuration="34.143232869s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:44.142087669 +0000 UTC m=+296.485127551" watchObservedRunningTime="2026-07-28 06:56:44.143232869 +0000 UTC m=+296.486272749" Jul 28 06:56:45.001503 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.001463 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:45.004013 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.003992 2582 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:45.114391 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.114350 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" event={"ID":"1f00d38c-33fc-41bc-8019-e857aab46132","Type":"ContainerStarted","Data":"d13e9c90171a789059e81f839a99580c00a47d4d6df989e58aad75073bfb5d55"} Jul 28 06:56:45.114880 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.114646 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:45.115818 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.115796 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-9b7f58fc7-t2zwc" Jul 28 06:56:45.130097 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:45.130056 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-6wq58" podStartSLOduration=33.537326783 podStartE2EDuration="35.130044681s" totalImagesPullingTime="1.592717898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:56:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:45.12890904 +0000 UTC m=+297.471948920" watchObservedRunningTime="2026-07-28 06:56:45.130044681 +0000 UTC m=+297.473084562" Jul 28 06:56:46.077254 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:46.077229 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-6896n" Jul 28 06:56:46.315681 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:46.315645 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:46.318089 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:46.318067 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ff03eec4-47e3-4c52-b831-d9ec4233bc9b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-nmp6x\" (UID: \"ff03eec4-47e3-4c52-b831-d9ec4233bc9b\") " pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:46.560782 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:46.560743 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-nmp6x" Jul 28 06:56:46.686342 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:46.686256 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-nmp6x"] Jul 28 06:56:46.688830 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:56:46.688808 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff03eec4_47e3_4c52_b831_d9ec4233bc9b.slice/crio-88c6a52dc4b8f97fda390a2e231f21cc6dbbd471807cabb1f89df06b5e718b0f WatchSource:0}: Error finding container 88c6a52dc4b8f97fda390a2e231f21cc6dbbd471807cabb1f89df06b5e718b0f: Status 404 returned error can't find the container with id 88c6a52dc4b8f97fda390a2e231f21cc6dbbd471807cabb1f89df06b5e718b0f Jul 28 06:56:47.122338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:47.122301 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmp6x" event={"ID":"ff03eec4-47e3-4c52-b831-d9ec4233bc9b","Type":"ContainerStarted","Data":"88c6a52dc4b8f97fda390a2e231f21cc6dbbd471807cabb1f89df06b5e718b0f"} Jul 28 06:56:48.014128 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:48.014091 2582 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 06:56:51.909842 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:51.909822 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 06:56:52.142853 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:52.142751 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmp6x" event={"ID":"ff03eec4-47e3-4c52-b831-d9ec4233bc9b","Type":"ContainerStarted","Data":"e19626383fa3e40a14fe683dc8fd7c17bb5143aa4f08fdc4e20282dd3fcae10b"} Jul 28 06:56:53.364614 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:53.364567 2582 patch_prober.go:28] interesting pod/image-registry-85dcdc469b-jgzh8 container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 06:56:53.365049 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:53.364637 2582 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 06:56:55.071939 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:55.071910 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:56:56.160732 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:56.160694 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmp6x" event={"ID":"ff03eec4-47e3-4c52-b831-d9ec4233bc9b","Type":"ContainerStarted","Data":"ce2bb8612814cf3159ee4dc82e33208e8c23bb706713609f80d2f057254d3115"} Jul 28 06:56:57.170974 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:57.170942 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:56:59.172998 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:59.172958 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-nmp6x" event={"ID":"ff03eec4-47e3-4c52-b831-d9ec4233bc9b","Type":"ContainerStarted","Data":"9ee97fb0828965cadbbeef14c1cff13fd149859802db851e0f94f925284de56f"} Jul 28 06:56:59.194166 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:56:59.194070 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-nmp6x" podStartSLOduration=33.064928276 podStartE2EDuration="45.19405182s" totalImagesPullingTime="12.129123544s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 06:56:14 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:56:59.193663784 +0000 UTC m=+311.536703665" watchObservedRunningTime="2026-07-28 06:56:59.19405182 +0000 UTC m=+311.537091703" Jul 28 06:57:01.294491 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:01.294461 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:57:09.491986 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.491945 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5"] Jul 28 06:57:09.495391 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.495375 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.498004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.497982 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 28 06:57:09.498714 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.498695 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 06:57:09.498785 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.498695 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 28 06:57:09.498785 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.498726 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-2qzqw\"" Jul 28 06:57:09.501167 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.501144 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qrmml"] Jul 28 06:57:09.504543 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.504525 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.507083 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.507052 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 06:57:09.507413 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.507388 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 06:57:09.507517 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.507419 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vhnzd\"" Jul 28 06:57:09.507517 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.507468 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 06:57:09.507517 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.507499 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5"] Jul 28 06:57:09.609412 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609374 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.609412 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609416 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-textfile\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609439 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609465 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609492 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-root\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609508 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-tls\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609545 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609566 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-wtmp\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609622 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-metrics-client-ca\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609668 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609646 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609954 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609676 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-sys\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609954 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9twfw\" (UniqueName: \"kubernetes.io/projected/59926dd6-f9a1-42bf-8c70-1551ef2b9575-kube-api-access-9twfw\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.609954 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.609773 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t6q9\" (UniqueName: \"kubernetes.io/projected/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-kube-api-access-2t6q9\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.710484 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710454 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.710484 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710486 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-wtmp\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710506 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-metrics-client-ca\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710530 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710555 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-sys\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710580 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9twfw\" (UniqueName: \"kubernetes.io/projected/59926dd6-f9a1-42bf-8c70-1551ef2b9575-kube-api-access-9twfw\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710618 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t6q9\" (UniqueName: \"kubernetes.io/projected/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-kube-api-access-2t6q9\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.710707 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710667 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-wtmp\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710701 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-sys\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710719 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710769 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-textfile\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710799 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710828 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710865 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-root\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711004 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.710890 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-tls\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711550 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.711103 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-textfile\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711550 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.711170 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/59926dd6-f9a1-42bf-8c70-1551ef2b9575-root\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711550 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.711215 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-metrics-client-ca\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.711550 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.711319 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-metrics-client-ca\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.711550 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.711421 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-accelerators-collector-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.713207 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.713167 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.713352 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.713334 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/59926dd6-f9a1-42bf-8c70-1551ef2b9575-node-exporter-tls\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.713503 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.713484 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-tls\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.713628 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.713612 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.722486 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.722462 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t6q9\" (UniqueName: \"kubernetes.io/projected/8b817863-7ecb-4300-a11c-0c1c80ca2b4d-kube-api-access-2t6q9\") pod \"openshift-state-metrics-b8f49f5c6-29dc5\" (UID: \"8b817863-7ecb-4300-a11c-0c1c80ca2b4d\") " pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.722704 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.722687 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9twfw\" (UniqueName: \"kubernetes.io/projected/59926dd6-f9a1-42bf-8c70-1551ef2b9575-kube-api-access-9twfw\") pod \"node-exporter-qrmml\" (UID: \"59926dd6-f9a1-42bf-8c70-1551ef2b9575\") " pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.804441 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.804360 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" Jul 28 06:57:09.813601 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.813377 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qrmml" Jul 28 06:57:09.825240 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:57:09.825204 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59926dd6_f9a1_42bf_8c70_1551ef2b9575.slice/crio-7abda7618cfe5152efa1d951d5fb98c52d04981ba04d662489c93284c4d8a87f WatchSource:0}: Error finding container 7abda7618cfe5152efa1d951d5fb98c52d04981ba04d662489c93284c4d8a87f: Status 404 returned error can't find the container with id 7abda7618cfe5152efa1d951d5fb98c52d04981ba04d662489c93284c4d8a87f Jul 28 06:57:09.941864 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:09.941842 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5"] Jul 28 06:57:09.944377 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:57:09.944355 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8b817863_7ecb_4300_a11c_0c1c80ca2b4d.slice/crio-1608cdd2e5f9877414061c463201b05f3177b0dba5855ec2a30cc1e3d8d95be4 WatchSource:0}: Error finding container 1608cdd2e5f9877414061c463201b05f3177b0dba5855ec2a30cc1e3d8d95be4: Status 404 returned error can't find the container with id 1608cdd2e5f9877414061c463201b05f3177b0dba5855ec2a30cc1e3d8d95be4 Jul 28 06:57:10.214996 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.214965 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrmml" event={"ID":"59926dd6-f9a1-42bf-8c70-1551ef2b9575","Type":"ContainerStarted","Data":"7abda7618cfe5152efa1d951d5fb98c52d04981ba04d662489c93284c4d8a87f"} Jul 28 06:57:10.216619 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.216594 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" event={"ID":"8b817863-7ecb-4300-a11c-0c1c80ca2b4d","Type":"ContainerStarted","Data":"c34903c782f94f399e3d1c979b074110b7372236a379e4e381e868ce20119904"} Jul 28 06:57:10.216757 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.216649 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" event={"ID":"8b817863-7ecb-4300-a11c-0c1c80ca2b4d","Type":"ContainerStarted","Data":"baafb4ca4c6d34b79039c139c1cb2bf96cd5fcc1decfaa93954d58744254a946"} Jul 28 06:57:10.216757 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.216669 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" event={"ID":"8b817863-7ecb-4300-a11c-0c1c80ca2b4d","Type":"ContainerStarted","Data":"1608cdd2e5f9877414061c463201b05f3177b0dba5855ec2a30cc1e3d8d95be4"} Jul 28 06:57:10.594908 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.594874 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 06:57:10.599215 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.599166 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.601716 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.601691 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 28 06:57:10.601716 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.601697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 28 06:57:10.601905 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.601697 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.602127 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.602424 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.602623 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9j2b4\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.602808 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.602981 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 28 06:57:10.603655 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.603510 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 28 06:57:10.604023 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.603678 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 28 06:57:10.612006 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.611982 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 06:57:10.717961 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.717931 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc5ft\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-kube-api-access-dc5ft\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718141 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.717984 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718141 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718046 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718141 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718090 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718141 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718131 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-out\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718205 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718238 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718270 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718315 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718345 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718564 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718372 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718564 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718414 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-web-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.718564 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.718489 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820566 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820489 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-web-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820745 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820578 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820745 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820636 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc5ft\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-kube-api-access-dc5ft\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820850 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820771 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820850 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820804 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820842 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.820960 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.820904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-out\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.821059 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821000 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.821059 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821036 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:10.821144 2582 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:10.821254 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls podName:ec4a8440-d2f3-45cf-b42f-062e155bc322 nodeName:}" failed. No retries permitted until 2026-07-28 06:57:11.32122527 +0000 UTC m=+323.664265131 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "ec4a8440-d2f3-45cf-b42f-062e155bc322") : secret "alertmanager-main-tls" not found Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821602 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821793 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821830 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.822193 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.821858 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.823139 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.823033 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.826462 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.826436 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.826727 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:10.826705 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle podName:ec4a8440-d2f3-45cf-b42f-062e155bc322 nodeName:}" failed. No retries permitted until 2026-07-28 06:57:11.326673574 +0000 UTC m=+323.669713512 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "ec4a8440-d2f3-45cf-b42f-062e155bc322") : configmap references non-existent config key: ca-bundle.crt Jul 28 06:57:10.827217 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.827130 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-tls-assets\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.828924 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.828875 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.829351 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.829300 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.830110 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.830074 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.830364 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.830347 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-volume\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.830761 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.830734 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.830947 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.830927 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ec4a8440-d2f3-45cf-b42f-062e155bc322-config-out\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.833986 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.833962 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-web-config\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:10.835979 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:10.835955 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc5ft\" (UniqueName: \"kubernetes.io/projected/ec4a8440-d2f3-45cf-b42f-062e155bc322-kube-api-access-dc5ft\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.326594 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.326547 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.329340 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.329315 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/ec4a8440-d2f3-45cf-b42f-062e155bc322-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.427903 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.427859 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.428598 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.428578 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec4a8440-d2f3-45cf-b42f-062e155bc322-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"ec4a8440-d2f3-45cf-b42f-062e155bc322\") " pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.515767 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.515735 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 28 06:57:11.670644 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:11.670613 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 28 06:57:11.673313 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:57:11.673286 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec4a8440_d2f3_45cf_b42f_062e155bc322.slice/crio-b9b431217595dc6546317a3ca3ef5384aefaebf75a64af2c086f5af60b8d9851 WatchSource:0}: Error finding container b9b431217595dc6546317a3ca3ef5384aefaebf75a64af2c086f5af60b8d9851: Status 404 returned error can't find the container with id b9b431217595dc6546317a3ca3ef5384aefaebf75a64af2c086f5af60b8d9851 Jul 28 06:57:12.227925 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:12.227882 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" event={"ID":"8b817863-7ecb-4300-a11c-0c1c80ca2b4d","Type":"ContainerStarted","Data":"9ffef8de54f9a8b1c5a195506cf2cb122c80d403af51cfc5ef6902c9135f490e"} Jul 28 06:57:12.229637 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:12.229606 2582 generic.go:356] "Generic (PLEG): container finished" podID="59926dd6-f9a1-42bf-8c70-1551ef2b9575" containerID="f2d7fa6f56d8bc43a0f1ab30f68078e54d8a7d4a134dbdfaa423526eacd10f54" exitCode=0 Jul 28 06:57:12.229934 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:12.229865 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrmml" event={"ID":"59926dd6-f9a1-42bf-8c70-1551ef2b9575","Type":"ContainerDied","Data":"f2d7fa6f56d8bc43a0f1ab30f68078e54d8a7d4a134dbdfaa423526eacd10f54"} Jul 28 06:57:12.232060 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:12.232034 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"b9b431217595dc6546317a3ca3ef5384aefaebf75a64af2c086f5af60b8d9851"} Jul 28 06:57:12.247368 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:12.247311 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-b8f49f5c6-29dc5" podStartSLOduration=2.124836642 podStartE2EDuration="3.2472893s" totalImagesPullingTime="1.122452658s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:12.243944889 +0000 UTC m=+324.586984770" watchObservedRunningTime="2026-07-28 06:57:12.2472893 +0000 UTC m=+324.590329183" Jul 28 06:57:13.238287 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:13.238243 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrmml" event={"ID":"59926dd6-f9a1-42bf-8c70-1551ef2b9575","Type":"ContainerStarted","Data":"3db750611abf14e06eb0ede818c763da003b3628c489292009aa6b084a894626"} Jul 28 06:57:13.238781 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:13.238306 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qrmml" event={"ID":"59926dd6-f9a1-42bf-8c70-1551ef2b9575","Type":"ContainerStarted","Data":"61a71752434c0cd6c5b34d1d97f63af5d630a797131dfb17428e02272e40f0cc"} Jul 28 06:57:13.239695 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:13.239671 2582 generic.go:356] "Generic (PLEG): container finished" podID="ec4a8440-d2f3-45cf-b42f-062e155bc322" containerID="a543316cdcfec1385481c8c75395c98a3fd28fc4db0c7bf441106bc1607f01b1" exitCode=0 Jul 28 06:57:13.239779 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:13.239759 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerDied","Data":"a543316cdcfec1385481c8c75395c98a3fd28fc4db0c7bf441106bc1607f01b1"} Jul 28 06:57:13.287521 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:13.287456 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qrmml" podStartSLOduration=2.84889392 podStartE2EDuration="4.287435831s" totalImagesPullingTime="1.361934172s" totalInitContainerRuntime="76.607739ms" isStatefulPod=true podCreationTimestamp="2026-07-28 06:57:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:13.260502963 +0000 UTC m=+325.603542844" watchObservedRunningTime="2026-07-28 06:57:13.287435831 +0000 UTC m=+325.630475712" Jul 28 06:57:14.305580 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.305542 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb"] Jul 28 06:57:14.309278 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.309250 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:14.312022 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.311875 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-c66fp\"" Jul 28 06:57:14.312022 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.311909 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 28 06:57:14.318774 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.318745 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb"] Jul 28 06:57:14.457649 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.457611 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bgjjd\" (UniqueName: \"kubernetes.io/projected/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-kube-api-access-bgjjd\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:14.457855 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.457753 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:14.558437 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.558350 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:14.558618 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.558436 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bgjjd\" (UniqueName: \"kubernetes.io/projected/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-kube-api-access-bgjjd\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:14.558618 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:14.558529 2582 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 28 06:57:14.558618 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:14.558608 2582 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert podName:b99744df-fac2-47b9-a0f6-a16ed1fb1fe4 nodeName:}" failed. No retries permitted until 2026-07-28 06:57:15.058588022 +0000 UTC m=+327.401627898 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert") pod "monitoring-plugin-68b7fc9574-tgxxb" (UID: "b99744df-fac2-47b9-a0f6-a16ed1fb1fe4") : secret "monitoring-plugin-cert" not found Jul 28 06:57:14.567523 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:14.567491 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bgjjd\" (UniqueName: \"kubernetes.io/projected/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-kube-api-access-bgjjd\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:15.061212 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.061189 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:15.063663 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.063641 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/b99744df-fac2-47b9-a0f6-a16ed1fb1fe4-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-tgxxb\" (UID: \"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:15.221780 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.221744 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:15.253044 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.253011 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"26fdbea4ba7c0c86bdb60e23cb0f8947fd6665a318796c0cc13f8f918ec846ae"} Jul 28 06:57:15.253247 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.253071 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"a8defd5288f332e7e7e47d715135ff499733ec68b031d468e991b0ecb1bb005c"} Jul 28 06:57:15.253247 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.253098 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"339d48bafa1fe8b5796c678c9c662e359d7ba59bbf3b3669db9cc49190557413"} Jul 28 06:57:15.253247 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.253121 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"8a359fd4aab6a723045948ccb7182e3029d527b0df7ced50e914ef5c4b9b3338"} Jul 28 06:57:15.253247 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.253145 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"1f8060da68856d608df9919296e312461521793b8599634fdbcfafcd7d3f0e7d"} Jul 28 06:57:15.354803 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:15.354723 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb"] Jul 28 06:57:15.358126 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:57:15.358101 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb99744df_fac2_47b9_a0f6_a16ed1fb1fe4.slice/crio-7565c655b48d7813296115872acf568ac0cfa8a4cbde4ddb3459ae55dcb196e0 WatchSource:0}: Error finding container 7565c655b48d7813296115872acf568ac0cfa8a4cbde4ddb3459ae55dcb196e0: Status 404 returned error can't find the container with id 7565c655b48d7813296115872acf568ac0cfa8a4cbde4ddb3459ae55dcb196e0 Jul 28 06:57:16.259299 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:16.259256 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" event={"ID":"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4","Type":"ContainerStarted","Data":"7565c655b48d7813296115872acf568ac0cfa8a4cbde4ddb3459ae55dcb196e0"} Jul 28 06:57:17.267544 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.267514 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"ec4a8440-d2f3-45cf-b42f-062e155bc322","Type":"ContainerStarted","Data":"01b9a3de998ca886117c2fc75e901cf110137e979e4bff7956082cf658f4c49e"} Jul 28 06:57:17.269020 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.268983 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" event={"ID":"b99744df-fac2-47b9-a0f6-a16ed1fb1fe4","Type":"ContainerStarted","Data":"1385c4e63bcaef409ef003decc5dacf8bb2b641422628ae46d64c8aaa1b21f71"} Jul 28 06:57:17.269133 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.269030 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:17.273944 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.273925 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" Jul 28 06:57:17.295121 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.295064 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=3.533914046 podStartE2EDuration="7.295043883s" totalImagesPullingTime="3.745055459s" totalInitContainerRuntime="16.074378ms" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:10 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:17.293665886 +0000 UTC m=+329.636705766" watchObservedRunningTime="2026-07-28 06:57:17.295043883 +0000 UTC m=+329.638083765" Jul 28 06:57:17.311983 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:17.311927 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-tgxxb" podStartSLOduration=1.497412963 podStartE2EDuration="3.311910016s" totalImagesPullingTime="1.814497053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:57:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:57:17.311351719 +0000 UTC m=+329.654391613" watchObservedRunningTime="2026-07-28 06:57:17.311910016 +0000 UTC m=+329.654949896" Jul 28 06:57:26.316081 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.316042 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerName="registry" containerID="cri-o://422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d" gracePeriod=30 Jul 28 06:57:26.570765 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.570701 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:57:26.666433 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666397 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666631 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666459 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666631 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666484 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666631 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666594 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666639 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t7cq4\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666672 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666706 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.666807 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666731 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets\") pod \"01feb784-588b-4d43-a4bb-a7404d82db2b\" (UID: \"01feb784-588b-4d43-a4bb-a7404d82db2b\") " Jul 28 06:57:26.667019 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666988 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:26.667077 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.666995 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 06:57:26.669282 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.669158 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4" (OuterVolumeSpecName: "kube-api-access-t7cq4") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "kube-api-access-t7cq4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:57:26.669443 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.669424 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:57:26.669510 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.669424 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:26.669566 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.669512 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 06:57:26.669661 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.669644 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:57:26.675778 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.675754 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "01feb784-588b-4d43-a4bb-a7404d82db2b" (UID: "01feb784-588b-4d43-a4bb-a7404d82db2b"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:57:26.768056 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768019 2582 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-bound-sa-token\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768056 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768051 2582 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-certificates\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768056 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768065 2582 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-image-registry-private-configuration\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768079 2582 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/01feb784-588b-4d43-a4bb-a7404d82db2b-trusted-ca\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768091 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t7cq4\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-kube-api-access-t7cq4\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768102 2582 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/01feb784-588b-4d43-a4bb-a7404d82db2b-registry-tls\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768113 2582 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/01feb784-588b-4d43-a4bb-a7404d82db2b-ca-trust-extracted\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:26.768338 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:26.768124 2582 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/01feb784-588b-4d43-a4bb-a7404d82db2b-installation-pull-secrets\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:57:27.308880 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.308848 2582 generic.go:356] "Generic (PLEG): container finished" podID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerID="422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d" exitCode=0 Jul 28 06:57:27.309090 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.308900 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" Jul 28 06:57:27.309090 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.308946 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" event={"ID":"01feb784-588b-4d43-a4bb-a7404d82db2b","Type":"ContainerDied","Data":"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d"} Jul 28 06:57:27.309090 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.308996 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-85dcdc469b-jgzh8" event={"ID":"01feb784-588b-4d43-a4bb-a7404d82db2b","Type":"ContainerDied","Data":"db546c40b8352c1875788ce6449edd7116f3159af71ffad422821b6e9f60b1de"} Jul 28 06:57:27.309090 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.309018 2582 scope.go:117] "RemoveContainer" containerID="422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d" Jul 28 06:57:27.317980 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.317899 2582 scope.go:117] "RemoveContainer" containerID="422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d" Jul 28 06:57:27.318262 ip-10-0-138-102 kubenswrapper[2582]: E0728 06:57:27.318143 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d\": container with ID starting with 422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d not found: ID does not exist" containerID="422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d" Jul 28 06:57:27.318262 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.318166 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d"} err="failed to get container status \"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d\": rpc error: code = NotFound desc = could not find container \"422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d\": container with ID starting with 422b369e6a7618e2e71e2d75361f7103cdecf3c883d30f30c6416bec1898ae4d not found: ID does not exist" Jul 28 06:57:27.329568 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.329538 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:57:27.333679 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:27.333658 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-85dcdc469b-jgzh8"] Jul 28 06:57:28.176405 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:28.176365 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" path="/var/lib/kubelet/pods/01feb784-588b-4d43-a4bb-a7404d82db2b/volumes" Jul 28 06:57:30.288289 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:30.288262 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9b7f58fc7-t2zwc_d11413a3-5eb8-4924-b16f-a95a6bc64cdb/router/0.log" Jul 28 06:57:30.295605 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:30.295581 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjmsb_2733f84f-ecd7-4ea2-b380-a44cc5cde4ec/serve-healthcheck-canary/0.log" Jul 28 06:57:30.322009 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:30.321973 2582 generic.go:356] "Generic (PLEG): container finished" podID="b9d848e8-a2d5-4d59-9e3d-89e75ec49d16" containerID="0d437089c96e32f60a056bd7ea3505fff9b8f7bded8f7e9ff9e575778e2066a0" exitCode=0 Jul 28 06:57:30.322153 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:30.322025 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" event={"ID":"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16","Type":"ContainerDied","Data":"0d437089c96e32f60a056bd7ea3505fff9b8f7bded8f7e9ff9e575778e2066a0"} Jul 28 06:57:30.322371 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:30.322356 2582 scope.go:117] "RemoveContainer" containerID="0d437089c96e32f60a056bd7ea3505fff9b8f7bded8f7e9ff9e575778e2066a0" Jul 28 06:57:31.331539 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:31.331509 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-22xnm" event={"ID":"b9d848e8-a2d5-4d59-9e3d-89e75ec49d16","Type":"ContainerStarted","Data":"f6712c20e2df27c7cae2c725279baefdb503586b795c2a50f9c7a4b7f6806c81"} Jul 28 06:57:40.365520 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:40.365483 2582 generic.go:356] "Generic (PLEG): container finished" podID="3f42843f-843b-4aa4-b2f1-d73766624a7a" containerID="bd8e0ec98609b771cc2a33818304cd4b82669c7b3e1e3f6daca7812d1962045a" exitCode=0 Jul 28 06:57:40.365947 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:40.365528 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" event={"ID":"3f42843f-843b-4aa4-b2f1-d73766624a7a","Type":"ContainerDied","Data":"bd8e0ec98609b771cc2a33818304cd4b82669c7b3e1e3f6daca7812d1962045a"} Jul 28 06:57:40.365947 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:40.365830 2582 scope.go:117] "RemoveContainer" containerID="bd8e0ec98609b771cc2a33818304cd4b82669c7b3e1e3f6daca7812d1962045a" Jul 28 06:57:41.371862 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:57:41.371830 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh" event={"ID":"3f42843f-843b-4aa4-b2f1-d73766624a7a","Type":"ContainerStarted","Data":"e579fb4d78ef435bd598183cdb947028f22fe9decf956fe9950fc31c7427d576"} Jul 28 06:58:02.053021 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.052981 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:58:02.055659 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.055633 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/2e0526d0-2279-4ced-b33d-22376dab5808-metrics-certs\") pod \"network-metrics-daemon-5rhzj\" (UID: \"2e0526d0-2279-4ced-b33d-22376dab5808\") " pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:58:02.274122 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.274086 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-mfvlz\"" Jul 28 06:58:02.281990 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.281965 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-5rhzj" Jul 28 06:58:02.421838 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.421775 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-5rhzj"] Jul 28 06:58:02.424442 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:58:02.424415 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e0526d0_2279_4ced_b33d_22376dab5808.slice/crio-6982386e5b684603f341d0437cc94f168a6c48dd5a84fcc3c95701536c186313 WatchSource:0}: Error finding container 6982386e5b684603f341d0437cc94f168a6c48dd5a84fcc3c95701536c186313: Status 404 returned error can't find the container with id 6982386e5b684603f341d0437cc94f168a6c48dd5a84fcc3c95701536c186313 Jul 28 06:58:02.454622 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:02.454588 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhzj" event={"ID":"2e0526d0-2279-4ced-b33d-22376dab5808","Type":"ContainerStarted","Data":"6982386e5b684603f341d0437cc94f168a6c48dd5a84fcc3c95701536c186313"} Jul 28 06:58:04.464126 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:04.464087 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhzj" event={"ID":"2e0526d0-2279-4ced-b33d-22376dab5808","Type":"ContainerStarted","Data":"7e6e83f7a76d75e839f01d78ee2674af5cc35a2e4f03d9421a0ab253ee8796d6"} Jul 28 06:58:04.464508 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:04.464152 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-5rhzj" event={"ID":"2e0526d0-2279-4ced-b33d-22376dab5808","Type":"ContainerStarted","Data":"6756cf19e514c1f8b278db096c88e660cce46045c45c9970912a01eb64e78fd7"} Jul 28 06:58:04.482040 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:58:04.481986 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-5rhzj" podStartSLOduration=374.512900639 podStartE2EDuration="6m15.481969935s" totalImagesPullingTime="969.069296ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:51:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:58:04.480203409 +0000 UTC m=+376.823243291" watchObservedRunningTime="2026-07-28 06:58:04.481969935 +0000 UTC m=+376.825009815" Jul 28 06:59:24.840018 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.836623 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4"] Jul 28 06:59:24.840018 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.837310 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerName="registry" Jul 28 06:59:24.840018 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.837330 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerName="registry" Jul 28 06:59:24.840018 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.837511 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="01feb784-588b-4d43-a4bb-a7404d82db2b" containerName="registry" Jul 28 06:59:24.841595 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.841573 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:24.844315 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.844291 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 06:59:24.845311 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.845295 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54mt2\"" Jul 28 06:59:24.845378 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.845295 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 06:59:24.848230 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.848208 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4"] Jul 28 06:59:24.995530 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.995495 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:24.995745 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.995543 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:24.995745 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:24.995583 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z6j65\" (UniqueName: \"kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.096924 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.096839 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z6j65\" (UniqueName: \"kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.096924 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.096900 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.096924 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.096926 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.097261 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.097242 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.097306 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.097253 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.105693 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.105665 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z6j65\" (UniqueName: \"kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.151922 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.151875 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:25.284150 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.284114 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4"] Jul 28 06:59:25.288245 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:59:25.288203 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8d3865df_6872_4269_a661_1ab1d281ab61.slice/crio-c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58 WatchSource:0}: Error finding container c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58: Status 404 returned error can't find the container with id c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58 Jul 28 06:59:25.773059 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:25.773022 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" event={"ID":"8d3865df-6872-4269-a661-1ab1d281ab61","Type":"ContainerStarted","Data":"c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58"} Jul 28 06:59:31.802805 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:31.802770 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d3865df-6872-4269-a661-1ab1d281ab61" containerID="c2d5420fd569fb1743586880a712a792a2e31c05831af5878b4e36e891a30c1b" exitCode=0 Jul 28 06:59:31.803224 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:31.802828 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" event={"ID":"8d3865df-6872-4269-a661-1ab1d281ab61","Type":"ContainerDied","Data":"c2d5420fd569fb1743586880a712a792a2e31c05831af5878b4e36e891a30c1b"} Jul 28 06:59:34.815529 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:34.815494 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d3865df-6872-4269-a661-1ab1d281ab61" containerID="39339c47c801eb8dee486c785f8921671e66187dcd41fa40992d504111a442d8" exitCode=0 Jul 28 06:59:34.815954 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:34.815562 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" event={"ID":"8d3865df-6872-4269-a661-1ab1d281ab61","Type":"ContainerDied","Data":"39339c47c801eb8dee486c785f8921671e66187dcd41fa40992d504111a442d8"} Jul 28 06:59:41.849464 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:41.849421 2582 generic.go:356] "Generic (PLEG): container finished" podID="8d3865df-6872-4269-a661-1ab1d281ab61" containerID="e18160ae42d7a4d69cdd36e8d88d68e1c015db37e8e1351c0986c007951990a1" exitCode=0 Jul 28 06:59:41.849880 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:41.849525 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" event={"ID":"8d3865df-6872-4269-a661-1ab1d281ab61","Type":"ContainerDied","Data":"e18160ae42d7a4d69cdd36e8d88d68e1c015db37e8e1351c0986c007951990a1"} Jul 28 06:59:42.986812 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:42.986789 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:43.151874 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.151792 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z6j65\" (UniqueName: \"kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65\") pod \"8d3865df-6872-4269-a661-1ab1d281ab61\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " Jul 28 06:59:43.151874 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.151844 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util\") pod \"8d3865df-6872-4269-a661-1ab1d281ab61\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " Jul 28 06:59:43.152095 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.151897 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle\") pod \"8d3865df-6872-4269-a661-1ab1d281ab61\" (UID: \"8d3865df-6872-4269-a661-1ab1d281ab61\") " Jul 28 06:59:43.152584 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.152559 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle" (OuterVolumeSpecName: "bundle") pod "8d3865df-6872-4269-a661-1ab1d281ab61" (UID: "8d3865df-6872-4269-a661-1ab1d281ab61"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:59:43.154240 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.154202 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65" (OuterVolumeSpecName: "kube-api-access-z6j65") pod "8d3865df-6872-4269-a661-1ab1d281ab61" (UID: "8d3865df-6872-4269-a661-1ab1d281ab61"). InnerVolumeSpecName "kube-api-access-z6j65". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 06:59:43.155829 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.155807 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util" (OuterVolumeSpecName: "util") pod "8d3865df-6872-4269-a661-1ab1d281ab61" (UID: "8d3865df-6872-4269-a661-1ab1d281ab61"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 06:59:43.253145 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.253098 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z6j65\" (UniqueName: \"kubernetes.io/projected/8d3865df-6872-4269-a661-1ab1d281ab61-kube-api-access-z6j65\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:59:43.253145 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.253140 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-util\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:59:43.253145 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.253150 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/8d3865df-6872-4269-a661-1ab1d281ab61-bundle\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 06:59:43.859107 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.859067 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" event={"ID":"8d3865df-6872-4269-a661-1ab1d281ab61","Type":"ContainerDied","Data":"c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58"} Jul 28 06:59:43.859107 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.859107 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wcpf4" Jul 28 06:59:43.859394 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:43.859116 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c7900a4689640bd95b1418009099e2a483840da0ca64012278467ac39e4ffa58" Jul 28 06:59:47.643497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.643460 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx"] Jul 28 06:59:47.644118 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644093 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="extract" Jul 28 06:59:47.644298 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644285 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="extract" Jul 28 06:59:47.644382 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644372 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="util" Jul 28 06:59:47.644447 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644439 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="util" Jul 28 06:59:47.644539 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644530 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="pull" Jul 28 06:59:47.644618 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644610 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="pull" Jul 28 06:59:47.644901 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.644889 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="8d3865df-6872-4269-a661-1ab1d281ab61" containerName="extract" Jul 28 06:59:47.659910 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.659881 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx"] Jul 28 06:59:47.660065 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.659978 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.662497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.662460 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-tl2nw\"" Jul 28 06:59:47.662497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.662474 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 06:59:47.662709 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.662590 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 06:59:47.790739 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.790693 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88926303-c615-4b5e-b65c-7356c43745bf-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.790914 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.790776 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzkt4\" (UniqueName: \"kubernetes.io/projected/88926303-c615-4b5e-b65c-7356c43745bf-kube-api-access-nzkt4\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.891227 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.891170 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88926303-c615-4b5e-b65c-7356c43745bf-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.891397 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.891236 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzkt4\" (UniqueName: \"kubernetes.io/projected/88926303-c615-4b5e-b65c-7356c43745bf-kube-api-access-nzkt4\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.891497 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.891476 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/88926303-c615-4b5e-b65c-7356c43745bf-tmp\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.899813 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.899767 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzkt4\" (UniqueName: \"kubernetes.io/projected/88926303-c615-4b5e-b65c-7356c43745bf-kube-api-access-nzkt4\") pod \"cert-manager-operator-controller-manager-56b4598547-kbmjx\" (UID: \"88926303-c615-4b5e-b65c-7356c43745bf\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:47.969731 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:47.969695 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" Jul 28 06:59:48.124390 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:48.124253 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx"] Jul 28 06:59:48.127387 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:59:48.127364 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod88926303_c615_4b5e_b65c_7356c43745bf.slice/crio-4f3659f34f671ed38cc0cb93ab96b7657dd5eca0a6ca139f73cf4055cd054e40 WatchSource:0}: Error finding container 4f3659f34f671ed38cc0cb93ab96b7657dd5eca0a6ca139f73cf4055cd054e40: Status 404 returned error can't find the container with id 4f3659f34f671ed38cc0cb93ab96b7657dd5eca0a6ca139f73cf4055cd054e40 Jul 28 06:59:48.880894 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:48.880861 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" event={"ID":"88926303-c615-4b5e-b65c-7356c43745bf","Type":"ContainerStarted","Data":"4f3659f34f671ed38cc0cb93ab96b7657dd5eca0a6ca139f73cf4055cd054e40"} Jul 28 06:59:50.892931 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:50.892839 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" event={"ID":"88926303-c615-4b5e-b65c-7356c43745bf","Type":"ContainerStarted","Data":"cf5af12380ca699f4d9008143ec72f3ba6e78e8808f6b620aa6c1439e71021e4"} Jul 28 06:59:51.536640 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.536575 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-56b4598547-kbmjx" podStartSLOduration=2.16097046 podStartE2EDuration="4.536550329s" totalImagesPullingTime="2.375579869s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:59:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:59:50.913852197 +0000 UTC m=+483.256892080" watchObservedRunningTime="2026-07-28 06:59:51.536550329 +0000 UTC m=+483.879590211" Jul 28 06:59:51.537874 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.537855 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r8q2z"] Jul 28 06:59:51.562086 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.562049 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r8q2z"] Jul 28 06:59:51.562246 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.562140 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.564928 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.564877 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 06:59:51.565138 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.564974 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-gq79q\"" Jul 28 06:59:51.565739 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.565690 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 06:59:51.619132 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.619095 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdgvd\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-kube-api-access-xdgvd\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.619340 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.619167 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.720198 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.720142 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.720364 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.720232 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdgvd\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-kube-api-access-xdgvd\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.730470 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.730443 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.730617 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.730563 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdgvd\" (UniqueName: \"kubernetes.io/projected/65706c1a-4492-454d-bf45-523ec6461736-kube-api-access-xdgvd\") pod \"cert-manager-webhook-6486ffd997-r8q2z\" (UID: \"65706c1a-4492-454d-bf45-523ec6461736\") " pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:51.881978 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:51.881901 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:52.023357 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:52.023327 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-r8q2z"] Jul 28 06:59:52.026641 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:59:52.026602 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod65706c1a_4492_454d_bf45_523ec6461736.slice/crio-9593ad118ddb9e800d6017b8772233bb7c7793815c7f3f3ea3b111ad315e4087 WatchSource:0}: Error finding container 9593ad118ddb9e800d6017b8772233bb7c7793815c7f3f3ea3b111ad315e4087: Status 404 returned error can't find the container with id 9593ad118ddb9e800d6017b8772233bb7c7793815c7f3f3ea3b111ad315e4087 Jul 28 06:59:52.902471 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:52.902437 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" event={"ID":"65706c1a-4492-454d-bf45-523ec6461736","Type":"ContainerStarted","Data":"9593ad118ddb9e800d6017b8772233bb7c7793815c7f3f3ea3b111ad315e4087"} Jul 28 06:59:54.914241 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:54.914208 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" event={"ID":"65706c1a-4492-454d-bf45-523ec6461736","Type":"ContainerStarted","Data":"fce111abd4885ede5914d721914383dd9bcf056eb2ed7464f9ebec2df106f5e7"} Jul 28 06:59:54.914649 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:54.914324 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 06:59:54.945171 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:54.945118 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" podStartSLOduration=1.247596369 podStartE2EDuration="3.945101139s" totalImagesPullingTime="2.69750477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:59:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:59:54.944472881 +0000 UTC m=+487.287512766" watchObservedRunningTime="2026-07-28 06:59:54.945101139 +0000 UTC m=+487.288141020" Jul 28 06:59:56.497409 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.497368 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mdv56"] Jul 28 06:59:56.499635 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.499620 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.501933 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.501913 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-7258j\"" Jul 28 06:59:56.510509 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.510489 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mdv56"] Jul 28 06:59:56.553829 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.553793 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.553977 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.553848 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-85n7v\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-kube-api-access-85n7v\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.654786 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.654737 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-85n7v\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-kube-api-access-85n7v\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.654989 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.654836 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.662912 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.662890 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.663199 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.663159 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-85n7v\" (UniqueName: \"kubernetes.io/projected/1ef32537-cb52-44ed-bbd8-50089caeb8b8-kube-api-access-85n7v\") pod \"cert-manager-cainjector-559cdd8c87-mdv56\" (UID: \"1ef32537-cb52-44ed-bbd8-50089caeb8b8\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.808783 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.808692 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" Jul 28 06:59:56.944141 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:56.944111 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mdv56"] Jul 28 06:59:56.946025 ip-10-0-138-102 kubenswrapper[2582]: W0728 06:59:56.945987 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1ef32537_cb52_44ed_bbd8_50089caeb8b8.slice/crio-d0d060499019f224db937066319b630e5cc67a4a52cdb7fd0287039e165f5fca WatchSource:0}: Error finding container d0d060499019f224db937066319b630e5cc67a4a52cdb7fd0287039e165f5fca: Status 404 returned error can't find the container with id d0d060499019f224db937066319b630e5cc67a4a52cdb7fd0287039e165f5fca Jul 28 06:59:57.929793 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:57.929758 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" event={"ID":"1ef32537-cb52-44ed-bbd8-50089caeb8b8","Type":"ContainerStarted","Data":"45dd236ced8cf7611186a3b60828f6daef326f3dd0638a3a30c9b175fbe28675"} Jul 28 06:59:57.929793 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:57.929799 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" event={"ID":"1ef32537-cb52-44ed-bbd8-50089caeb8b8","Type":"ContainerStarted","Data":"d0d060499019f224db937066319b630e5cc67a4a52cdb7fd0287039e165f5fca"} Jul 28 06:59:57.945045 ip-10-0-138-102 kubenswrapper[2582]: I0728 06:59:57.944984 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mdv56" podStartSLOduration=1.944963926 podStartE2EDuration="1.944963926s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 06:59:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 06:59:57.944824997 +0000 UTC m=+490.287864878" watchObservedRunningTime="2026-07-28 06:59:57.944963926 +0000 UTC m=+490.288003808" Jul 28 07:00:00.922151 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:00.922117 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-r8q2z" Jul 28 07:00:11.236449 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.236416 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6"] Jul 28 07:00:11.238732 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.238716 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.241227 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.241204 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 07:00:11.242012 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.241996 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 07:00:11.242012 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.242015 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-54mt2\"" Jul 28 07:00:11.247719 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.247696 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6"] Jul 28 07:00:11.251535 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.251513 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.251653 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.251550 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.251653 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.251629 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d77d\" (UniqueName: \"kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.352380 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.352343 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d77d\" (UniqueName: \"kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.352589 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.352388 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.352589 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.352418 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.352859 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.352839 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.352925 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.352867 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.361286 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.361254 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d77d\" (UniqueName: \"kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d\") pod \"c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.549530 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.549483 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:11.683485 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.683463 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6"] Jul 28 07:00:11.685736 ip-10-0-138-102 kubenswrapper[2582]: W0728 07:00:11.685707 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32fe037b_0f68_40cd_92be_ead0dcadc3c6.slice/crio-e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1 WatchSource:0}: Error finding container e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1: Status 404 returned error can't find the container with id e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1 Jul 28 07:00:11.992913 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.992884 2582 generic.go:356] "Generic (PLEG): container finished" podID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerID="6c8e660125d8b92eedf0bfd4d378d432af4a5104cdbf9816cd2caf65d70c3056" exitCode=0 Jul 28 07:00:11.993108 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.992979 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" event={"ID":"32fe037b-0f68-40cd-92be-ead0dcadc3c6","Type":"ContainerDied","Data":"6c8e660125d8b92eedf0bfd4d378d432af4a5104cdbf9816cd2caf65d70c3056"} Jul 28 07:00:11.993108 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:11.993040 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" event={"ID":"32fe037b-0f68-40cd-92be-ead0dcadc3c6","Type":"ContainerStarted","Data":"e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1"} Jul 28 07:00:15.009225 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:15.009169 2582 generic.go:356] "Generic (PLEG): container finished" podID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerID="9f1e2f0b75813fd84d3acde832436c0c38b5cb05cb2a41e7a02b0ef727eab2be" exitCode=0 Jul 28 07:00:15.009225 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:15.009220 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" event={"ID":"32fe037b-0f68-40cd-92be-ead0dcadc3c6","Type":"ContainerDied","Data":"9f1e2f0b75813fd84d3acde832436c0c38b5cb05cb2a41e7a02b0ef727eab2be"} Jul 28 07:00:16.015685 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:16.015650 2582 generic.go:356] "Generic (PLEG): container finished" podID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerID="cd9e6839319499932d3d303f2477f27dce240c105775ee02dbd6874372d4af1c" exitCode=0 Jul 28 07:00:16.016061 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:16.015729 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" event={"ID":"32fe037b-0f68-40cd-92be-ead0dcadc3c6","Type":"ContainerDied","Data":"cd9e6839319499932d3d303f2477f27dce240c105775ee02dbd6874372d4af1c"} Jul 28 07:00:17.148539 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.148510 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:17.201493 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.201454 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle\") pod \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " Jul 28 07:00:17.201697 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.201541 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util\") pod \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " Jul 28 07:00:17.201697 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.201571 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d77d\" (UniqueName: \"kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d\") pod \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\" (UID: \"32fe037b-0f68-40cd-92be-ead0dcadc3c6\") " Jul 28 07:00:17.201919 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.201892 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle" (OuterVolumeSpecName: "bundle") pod "32fe037b-0f68-40cd-92be-ead0dcadc3c6" (UID: "32fe037b-0f68-40cd-92be-ead0dcadc3c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:00:17.203972 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.203931 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d" (OuterVolumeSpecName: "kube-api-access-8d77d") pod "32fe037b-0f68-40cd-92be-ead0dcadc3c6" (UID: "32fe037b-0f68-40cd-92be-ead0dcadc3c6"). InnerVolumeSpecName "kube-api-access-8d77d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:00:17.207497 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.207474 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util" (OuterVolumeSpecName: "util") pod "32fe037b-0f68-40cd-92be-ead0dcadc3c6" (UID: "32fe037b-0f68-40cd-92be-ead0dcadc3c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:00:17.302393 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.302299 2582 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-bundle\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:00:17.302393 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.302332 2582 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/32fe037b-0f68-40cd-92be-ead0dcadc3c6-util\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:00:17.302393 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:17.302341 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d77d\" (UniqueName: \"kubernetes.io/projected/32fe037b-0f68-40cd-92be-ead0dcadc3c6-kube-api-access-8d77d\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:00:18.027314 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:18.027275 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" event={"ID":"32fe037b-0f68-40cd-92be-ead0dcadc3c6","Type":"ContainerDied","Data":"e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1"} Jul 28 07:00:18.027463 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:18.027323 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/c2ca89134faa49158137edb0141b62ea0c6a854657aff316cf72d9c78espgx6" Jul 28 07:00:18.027463 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:18.027356 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e8f5e8a86145ededd62112846265fb009950aa206a31ddaa3646df2a2a9477d1" Jul 28 07:00:23.656986 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.656947 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx"] Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657277 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="extract" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657289 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="extract" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657306 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="util" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657312 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="util" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657320 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="pull" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657325 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="pull" Jul 28 07:00:23.657469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.657391 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="32fe037b-0f68-40cd-92be-ead0dcadc3c6" containerName="extract" Jul 28 07:00:23.659639 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.659624 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.661952 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.661931 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"kube-root-ca.crt\"" Jul 28 07:00:23.662817 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.662800 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-jobset-operator\"/\"jobset-operator-dockercfg-gs56g\"" Jul 28 07:00:23.662919 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.662815 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-jobset-operator\"/\"openshift-service-ca.crt\"" Jul 28 07:00:23.668142 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.668121 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx"] Jul 28 07:00:23.757740 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.757704 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzvtv\" (UniqueName: \"kubernetes.io/projected/09b0f91c-02c3-4d16-93d7-20303dd182ca-kube-api-access-bzvtv\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.757740 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.757750 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09b0f91c-02c3-4d16-93d7-20303dd182ca-tmp\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.859111 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.859069 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzvtv\" (UniqueName: \"kubernetes.io/projected/09b0f91c-02c3-4d16-93d7-20303dd182ca-kube-api-access-bzvtv\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.859320 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.859119 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09b0f91c-02c3-4d16-93d7-20303dd182ca-tmp\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.859526 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.859507 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09b0f91c-02c3-4d16-93d7-20303dd182ca-tmp\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.866893 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.866860 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzvtv\" (UniqueName: \"kubernetes.io/projected/09b0f91c-02c3-4d16-93d7-20303dd182ca-kube-api-access-bzvtv\") pod \"jobset-operator-5bc45f897-fvkpx\" (UID: \"09b0f91c-02c3-4d16-93d7-20303dd182ca\") " pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:23.969946 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:23.969878 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" Jul 28 07:00:24.103897 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:24.103867 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx"] Jul 28 07:00:24.108385 ip-10-0-138-102 kubenswrapper[2582]: W0728 07:00:24.108353 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod09b0f91c_02c3_4d16_93d7_20303dd182ca.slice/crio-cf6fbb021fa732f822385772100713fa58e268c00c2bacf1af97edbcfdd5ad40 WatchSource:0}: Error finding container cf6fbb021fa732f822385772100713fa58e268c00c2bacf1af97edbcfdd5ad40: Status 404 returned error can't find the container with id cf6fbb021fa732f822385772100713fa58e268c00c2bacf1af97edbcfdd5ad40 Jul 28 07:00:25.065342 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:25.065310 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" event={"ID":"09b0f91c-02c3-4d16-93d7-20303dd182ca","Type":"ContainerStarted","Data":"cf6fbb021fa732f822385772100713fa58e268c00c2bacf1af97edbcfdd5ad40"} Jul 28 07:00:27.075902 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:27.075859 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" event={"ID":"09b0f91c-02c3-4d16-93d7-20303dd182ca","Type":"ContainerStarted","Data":"5dd3669d430a175b16bd18682faddd64b77a526ffb61301f53d18361ca54eea5"} Jul 28 07:00:27.091406 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:00:27.091341 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-jobset-operator/jobset-operator-5bc45f897-fvkpx" podStartSLOduration=1.958065143 podStartE2EDuration="4.091322609s" totalImagesPullingTime="2.133257466s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:00:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:00:27.090898496 +0000 UTC m=+519.433938379" watchObservedRunningTime="2026-07-28 07:00:27.091322609 +0000 UTC m=+519.434362491" Jul 28 07:02:47.464489 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.464448 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-pz7xj"] Jul 28 07:02:47.467869 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.467853 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:02:47.470776 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.470751 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 07:02:47.470895 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.470825 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 07:02:47.471793 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.471772 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-nfj48\"" Jul 28 07:02:47.477706 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.477688 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-pz7xj"] Jul 28 07:02:47.534860 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.534822 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4fzpb\" (UniqueName: \"kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb\") pod \"test-trainjob-workflow-node-0-0-pz7xj\" (UID: \"52119e50-8881-4d0b-b625-b4721bbee809\") " pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:02:47.635883 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.635832 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4fzpb\" (UniqueName: \"kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb\") pod \"test-trainjob-workflow-node-0-0-pz7xj\" (UID: \"52119e50-8881-4d0b-b625-b4721bbee809\") " pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:02:47.644155 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.644121 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4fzpb\" (UniqueName: \"kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb\") pod \"test-trainjob-workflow-node-0-0-pz7xj\" (UID: \"52119e50-8881-4d0b-b625-b4721bbee809\") " pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:02:47.777528 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.777495 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:02:47.913048 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.913025 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-pz7xj"] Jul 28 07:02:47.915743 ip-10-0-138-102 kubenswrapper[2582]: W0728 07:02:47.915717 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod52119e50_8881_4d0b_b625_b4721bbee809.slice/crio-dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7 WatchSource:0}: Error finding container dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7: Status 404 returned error can't find the container with id dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7 Jul 28 07:02:47.917728 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:47.917712 2582 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 07:02:48.724116 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:02:48.724082 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" event={"ID":"52119e50-8881-4d0b-b625-b4721bbee809","Type":"ContainerStarted","Data":"dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7"} Jul 28 07:03:55.103405 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:55.103356 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" event={"ID":"52119e50-8881-4d0b-b625-b4721bbee809","Type":"ContainerStarted","Data":"8af45b2d209429d438574fcb65f8708caa64dd45fde922625e39d5b365742a97"} Jul 28 07:03:55.123928 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:55.123863 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" podStartSLOduration=1.592582116 podStartE2EDuration="1m8.123844144s" totalImagesPullingTime="1m6.531262028s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 07:02:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:03:55.123402888 +0000 UTC m=+727.466442766" watchObservedRunningTime="2026-07-28 07:03:55.123844144 +0000 UTC m=+727.466884029" Jul 28 07:03:58.119527 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:58.119488 2582 generic.go:356] "Generic (PLEG): container finished" podID="52119e50-8881-4d0b-b625-b4721bbee809" containerID="8af45b2d209429d438574fcb65f8708caa64dd45fde922625e39d5b365742a97" exitCode=0 Jul 28 07:03:58.119527 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:58.119532 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" event={"ID":"52119e50-8881-4d0b-b625-b4721bbee809","Type":"ContainerDied","Data":"8af45b2d209429d438574fcb65f8708caa64dd45fde922625e39d5b365742a97"} Jul 28 07:03:59.291963 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:59.291928 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:03:59.395615 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:59.395529 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4fzpb\" (UniqueName: \"kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb\") pod \"52119e50-8881-4d0b-b625-b4721bbee809\" (UID: \"52119e50-8881-4d0b-b625-b4721bbee809\") " Jul 28 07:03:59.397907 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:59.397881 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb" (OuterVolumeSpecName: "kube-api-access-4fzpb") pod "52119e50-8881-4d0b-b625-b4721bbee809" (UID: "52119e50-8881-4d0b-b625-b4721bbee809"). InnerVolumeSpecName "kube-api-access-4fzpb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:03:59.496727 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:03:59.496689 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4fzpb\" (UniqueName: \"kubernetes.io/projected/52119e50-8881-4d0b-b625-b4721bbee809-kube-api-access-4fzpb\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:04:00.129975 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:00.129945 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" Jul 28 07:04:00.130243 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:00.129946 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-trainjob-workflow-node-0-0-pz7xj" event={"ID":"52119e50-8881-4d0b-b625-b4721bbee809","Type":"ContainerDied","Data":"dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7"} Jul 28 07:04:00.130243 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:00.130074 2582 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dac9e635f1a350b19f47d22add929e68fd12fce02a6429afc79838afb4ae4fd7" Jul 28 07:04:00.756236 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:00.756200 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-pz7xj"] Jul 28 07:04:00.767375 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:00.767334 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-trainjob-workflow-node-0-0-pz7xj"] Jul 28 07:04:02.177076 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:02.177040 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="52119e50-8881-4d0b-b625-b4721bbee809" path="/var/lib/kubelet/pods/52119e50-8881-4d0b-b625-b4721bbee809/volumes" Jul 28 07:04:04.713725 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.713682 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j8dsp/must-gather-c8f8v"] Jul 28 07:04:04.714297 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.714152 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="52119e50-8881-4d0b-b625-b4721bbee809" containerName="node" Jul 28 07:04:04.714297 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.714170 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="52119e50-8881-4d0b-b625-b4721bbee809" containerName="node" Jul 28 07:04:04.714422 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.714311 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="52119e50-8881-4d0b-b625-b4721bbee809" containerName="node" Jul 28 07:04:04.741733 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.741696 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8dsp/must-gather-c8f8v"] Jul 28 07:04:04.741900 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.741830 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.744388 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.744353 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8dsp\"/\"openshift-service-ca.crt\"" Jul 28 07:04:04.745370 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.745339 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j8dsp\"/\"default-dockercfg-pcgmd\"" Jul 28 07:04:04.745495 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.745400 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j8dsp\"/\"kube-root-ca.crt\"" Jul 28 07:04:04.843128 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.843091 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.843334 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.843140 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lrlh\" (UniqueName: \"kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.944465 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.944422 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lrlh\" (UniqueName: \"kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.944663 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.944540 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.944900 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.944879 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:04.959051 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:04.959018 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lrlh\" (UniqueName: \"kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh\") pod \"must-gather-c8f8v\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:05.051556 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:05.051519 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:04:05.235368 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:05.235335 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j8dsp/must-gather-c8f8v"] Jul 28 07:04:05.238601 ip-10-0-138-102 kubenswrapper[2582]: W0728 07:04:05.238571 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod751683e7_30e9_47c2_a2d5_eda211bc1b16.slice/crio-db737fa288523aa6e25a5cdf9ff913f2664d381585cbf35aa8ee282803a7a805 WatchSource:0}: Error finding container db737fa288523aa6e25a5cdf9ff913f2664d381585cbf35aa8ee282803a7a805: Status 404 returned error can't find the container with id db737fa288523aa6e25a5cdf9ff913f2664d381585cbf35aa8ee282803a7a805 Jul 28 07:04:06.159292 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:06.159255 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" event={"ID":"751683e7-30e9-47c2-a2d5-eda211bc1b16","Type":"ContainerStarted","Data":"db737fa288523aa6e25a5cdf9ff913f2664d381585cbf35aa8ee282803a7a805"} Jul 28 07:04:14.208441 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:14.208344 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" event={"ID":"751683e7-30e9-47c2-a2d5-eda211bc1b16","Type":"ContainerStarted","Data":"15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9"} Jul 28 07:04:14.208441 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:04:14.208421 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" event={"ID":"751683e7-30e9-47c2-a2d5-eda211bc1b16","Type":"ContainerStarted","Data":"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450"} Jul 28 07:05:01.461042 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:01.461005 2582 generic.go:356] "Generic (PLEG): container finished" podID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerID="d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450" exitCode=0 Jul 28 07:05:01.461514 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:01.461080 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" event={"ID":"751683e7-30e9-47c2-a2d5-eda211bc1b16","Type":"ContainerDied","Data":"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450"} Jul 28 07:05:01.461514 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:01.461449 2582 scope.go:117] "RemoveContainer" containerID="d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450" Jul 28 07:05:02.348908 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:02.348878 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j8dsp_must-gather-c8f8v_751683e7-30e9-47c2-a2d5-eda211bc1b16/gather/0.log" Jul 28 07:05:06.808146 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:06.808112 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-r29hp_ebea1bb7-d532-4665-8c84-6b0efc41db93/global-pull-secret-syncer/0.log" Jul 28 07:05:06.890296 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:06.890259 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-9wfk4_fcd63612-cfa5-441e-9149-bc7d6026553a/konnectivity-agent/0.log" Jul 28 07:05:06.975957 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:06.975928 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-102.ec2.internal_ad4bef192bb3177a88105cc53b643b33/haproxy/0.log" Jul 28 07:05:07.688592 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.688556 2582 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-must-gather-j8dsp/must-gather-c8f8v"] Jul 28 07:05:07.688787 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.688768 2582 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="copy" containerID="cri-o://15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9" gracePeriod=2 Jul 28 07:05:07.692121 ip-10-0-138-102 kubenswrapper[2582]: E0728 07:05:07.692091 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-c8f8v\" is forbidden: User \"system:node:ip-10-0-138-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j8dsp\": no relationship found between node 'ip-10-0-138-102.ec2.internal' and this object" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:05:07.693217 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.693166 2582 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-must-gather-j8dsp/must-gather-c8f8v"] Jul 28 07:05:07.928327 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.928305 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j8dsp_must-gather-c8f8v_751683e7-30e9-47c2-a2d5-eda211bc1b16/copy/0.log" Jul 28 07:05:07.929942 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.929926 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:05:07.931974 ip-10-0-138-102 kubenswrapper[2582]: E0728 07:05:07.931946 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-c8f8v\" is forbidden: User \"system:node:ip-10-0-138-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j8dsp\": no relationship found between node 'ip-10-0-138-102.ec2.internal' and this object" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:05:07.987788 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.987760 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lrlh\" (UniqueName: \"kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh\") pod \"751683e7-30e9-47c2-a2d5-eda211bc1b16\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " Jul 28 07:05:07.987932 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.987825 2582 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output\") pod \"751683e7-30e9-47c2-a2d5-eda211bc1b16\" (UID: \"751683e7-30e9-47c2-a2d5-eda211bc1b16\") " Jul 28 07:05:07.989121 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.989090 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output" (OuterVolumeSpecName: "must-gather-output") pod "751683e7-30e9-47c2-a2d5-eda211bc1b16" (UID: "751683e7-30e9-47c2-a2d5-eda211bc1b16"). InnerVolumeSpecName "must-gather-output". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 07:05:07.990152 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:07.990120 2582 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh" (OuterVolumeSpecName: "kube-api-access-9lrlh") pod "751683e7-30e9-47c2-a2d5-eda211bc1b16" (UID: "751683e7-30e9-47c2-a2d5-eda211bc1b16"). InnerVolumeSpecName "kube-api-access-9lrlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 07:05:08.088804 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.088760 2582 reconciler_common.go:299] "Volume detached for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/751683e7-30e9-47c2-a2d5-eda211bc1b16-must-gather-output\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:05:08.088804 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.088795 2582 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lrlh\" (UniqueName: \"kubernetes.io/projected/751683e7-30e9-47c2-a2d5-eda211bc1b16-kube-api-access-9lrlh\") on node \"ip-10-0-138-102.ec2.internal\" DevicePath \"\"" Jul 28 07:05:08.176284 ip-10-0-138-102 kubenswrapper[2582]: E0728 07:05:08.176250 2582 status_manager.go:1018] "Failed to get status for pod" err="pods \"must-gather-c8f8v\" is forbidden: User \"system:node:ip-10-0-138-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-must-gather-j8dsp\": no relationship found between node 'ip-10-0-138-102.ec2.internal' and this object" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:05:08.177771 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.177747 2582 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" path="/var/lib/kubelet/pods/751683e7-30e9-47c2-a2d5-eda211bc1b16/volumes" Jul 28 07:05:08.499632 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.499603 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-must-gather-j8dsp_must-gather-c8f8v_751683e7-30e9-47c2-a2d5-eda211bc1b16/copy/0.log" Jul 28 07:05:08.500004 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.499982 2582 generic.go:356] "Generic (PLEG): container finished" podID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerID="15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9" exitCode=143 Jul 28 07:05:08.500101 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.500034 2582 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j8dsp/must-gather-c8f8v" Jul 28 07:05:08.500101 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.500088 2582 scope.go:117] "RemoveContainer" containerID="15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9" Jul 28 07:05:08.508190 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.508156 2582 scope.go:117] "RemoveContainer" containerID="d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450" Jul 28 07:05:08.520961 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.520941 2582 scope.go:117] "RemoveContainer" containerID="15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9" Jul 28 07:05:08.521333 ip-10-0-138-102 kubenswrapper[2582]: E0728 07:05:08.521310 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9\": container with ID starting with 15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9 not found: ID does not exist" containerID="15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9" Jul 28 07:05:08.521435 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.521346 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9"} err="failed to get container status \"15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9\": rpc error: code = NotFound desc = could not find container \"15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9\": container with ID starting with 15ba0bc741401c0915dbc9bc24f38bb6c03a4ca439c6af8ad7dc8a8360a38bd9 not found: ID does not exist" Jul 28 07:05:08.521435 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.521379 2582 scope.go:117] "RemoveContainer" containerID="d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450" Jul 28 07:05:08.521652 ip-10-0-138-102 kubenswrapper[2582]: E0728 07:05:08.521632 2582 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450\": container with ID starting with d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450 not found: ID does not exist" containerID="d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450" Jul 28 07:05:08.521693 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:08.521658 2582 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450"} err="failed to get container status \"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450\": rpc error: code = NotFound desc = could not find container \"d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450\": container with ID starting with d579abd5448217312c9016892377afcb60da7d2593bc5c3b7ac16cc26e423450 not found: ID does not exist" Jul 28 07:05:12.074795 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.074762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/alertmanager/0.log" Jul 28 07:05:12.145036 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.145010 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/config-reloader/0.log" Jul 28 07:05:12.177123 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.177092 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/kube-rbac-proxy-web/0.log" Jul 28 07:05:12.211148 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.211124 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/kube-rbac-proxy/0.log" Jul 28 07:05:12.253282 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.253260 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/kube-rbac-proxy-metric/0.log" Jul 28 07:05:12.282806 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.282770 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/prom-label-proxy/0.log" Jul 28 07:05:12.327901 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.327790 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_ec4a8440-d2f3-45cf-b42f-062e155bc322/init-config-reloader/0.log" Jul 28 07:05:12.378085 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.378055 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-6wq58_1f00d38c-33fc-41bc-8019-e857aab46132/cluster-monitoring-operator/0.log" Jul 28 07:05:12.592219 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.592128 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-tgxxb_b99744df-fac2-47b9-a0f6-a16ed1fb1fe4/monitoring-plugin/0.log" Jul 28 07:05:12.859303 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.859223 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrmml_59926dd6-f9a1-42bf-8c70-1551ef2b9575/node-exporter/0.log" Jul 28 07:05:12.888535 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.888511 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrmml_59926dd6-f9a1-42bf-8c70-1551ef2b9575/kube-rbac-proxy/0.log" Jul 28 07:05:12.931538 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.931508 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qrmml_59926dd6-f9a1-42bf-8c70-1551ef2b9575/init-textfile/0.log" Jul 28 07:05:12.980794 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:12.980762 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-29dc5_8b817863-7ecb-4300-a11c-0c1c80ca2b4d/kube-rbac-proxy-main/0.log" Jul 28 07:05:13.009888 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:13.009861 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-29dc5_8b817863-7ecb-4300-a11c-0c1c80ca2b4d/kube-rbac-proxy-self/0.log" Jul 28 07:05:13.040461 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:13.040435 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-b8f49f5c6-29dc5_8b817863-7ecb-4300-a11c-0c1c80ca2b4d/openshift-state-metrics/0.log" Jul 28 07:05:15.364598 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:15.364565 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-fd5lk_d2226b4c-4e2a-46bf-8488-1366bf0190f1/networking-console-plugin/0.log" Jul 28 07:05:17.615995 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:17.615967 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-p26h6_c00e8859-9778-4263-9865-4897277dcda5/volume-data-source-validator/0.log" Jul 28 07:05:18.273224 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273191 2582 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742"] Jul 28 07:05:18.273676 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273653 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="copy" Jul 28 07:05:18.273676 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273670 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="copy" Jul 28 07:05:18.273758 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273685 2582 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="gather" Jul 28 07:05:18.273758 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273691 2582 state_mem.go:107] "Deleted CPUSet assignment" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="gather" Jul 28 07:05:18.273758 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273758 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="copy" Jul 28 07:05:18.273863 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.273768 2582 memory_manager.go:368] "RemoveStaleState removing state" podUID="751683e7-30e9-47c2-a2d5-eda211bc1b16" containerName="gather" Jul 28 07:05:18.275684 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.275664 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.278067 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.278047 2582 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-xtz5m\"/\"default-dockercfg-zrvbx\"" Jul 28 07:05:18.278141 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.278047 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtz5m\"/\"openshift-service-ca.crt\"" Jul 28 07:05:18.278952 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.278928 2582 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-xtz5m\"/\"kube-root-ca.crt\"" Jul 28 07:05:18.286469 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.286450 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742"] Jul 28 07:05:18.378796 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.378759 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-podres\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.378796 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.378801 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-lib-modules\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.378981 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.378881 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2jlc\" (UniqueName: \"kubernetes.io/projected/371f3df1-fa3b-451e-8d0c-e3684e9dbace-kube-api-access-x2jlc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.378981 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.378937 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-sys\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.378981 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.378958 2582 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-proc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.479887 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479855 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2jlc\" (UniqueName: \"kubernetes.io/projected/371f3df1-fa3b-451e-8d0c-e3684e9dbace-kube-api-access-x2jlc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480008 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479904 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-sys\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480008 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479927 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-proc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480008 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479964 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-podres\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480008 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479985 2582 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-lib-modules\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480008 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.479986 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-sys\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480206 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.480068 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-proc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480206 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.480121 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-lib-modules\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.480206 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.480134 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/371f3df1-fa3b-451e-8d0c-e3684e9dbace-podres\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.487976 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.487948 2582 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2jlc\" (UniqueName: \"kubernetes.io/projected/371f3df1-fa3b-451e-8d0c-e3684e9dbace-kube-api-access-x2jlc\") pod \"perf-node-gather-daemonset-br742\" (UID: \"371f3df1-fa3b-451e-8d0c-e3684e9dbace\") " pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.586346 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.586255 2582 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:18.717569 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.717543 2582 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742"] Jul 28 07:05:18.720405 ip-10-0-138-102 kubenswrapper[2582]: W0728 07:05:18.720377 2582 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod371f3df1_fa3b_451e_8d0c_e3684e9dbace.slice/crio-49af17c4a4c1b73303c2b436fbc16595c142d8f2074ab1681cf186b232ed6c30 WatchSource:0}: Error finding container 49af17c4a4c1b73303c2b436fbc16595c142d8f2074ab1681cf186b232ed6c30: Status 404 returned error can't find the container with id 49af17c4a4c1b73303c2b436fbc16595c142d8f2074ab1681cf186b232ed6c30 Jul 28 07:05:18.803172 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.803129 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6896n_336186c1-2f48-40ed-956a-1dbabaca27d6/dns/0.log" Jul 28 07:05:18.832294 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.832267 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-6896n_336186c1-2f48-40ed-956a-1dbabaca27d6/kube-rbac-proxy/0.log" Jul 28 07:05:18.982143 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:18.982068 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-fgzpd_f1c34b94-f4b9-4c33-8535-5acb369ef0cf/dns-node-resolver/0.log" Jul 28 07:05:19.551003 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:19.550967 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" event={"ID":"371f3df1-fa3b-451e-8d0c-e3684e9dbace","Type":"ContainerStarted","Data":"b2ef4b0d9832556e729887abb8a80502811da836f73d8e0701aaa08301c7b72d"} Jul 28 07:05:19.551207 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:19.551017 2582 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" event={"ID":"371f3df1-fa3b-451e-8d0c-e3684e9dbace","Type":"ContainerStarted","Data":"49af17c4a4c1b73303c2b436fbc16595c142d8f2074ab1681cf186b232ed6c30"} Jul 28 07:05:19.551207 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:19.551040 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:19.568912 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:19.568867 2582 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" podStartSLOduration=1.568851055 podStartE2EDuration="1.568851055s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 07:05:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 07:05:19.566311349 +0000 UTC m=+811.909351230" watchObservedRunningTime="2026-07-28 07:05:19.568851055 +0000 UTC m=+811.911890937" Jul 28 07:05:19.668327 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:19.668290 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wl9tg_6b41361a-8b8b-4c72-9141-f21158c72f09/node-ca/0.log" Jul 28 07:05:20.578206 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:20.578156 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-9b7f58fc7-t2zwc_d11413a3-5eb8-4924-b16f-a95a6bc64cdb/router/0.log" Jul 28 07:05:21.004341 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:21.004304 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-mjmsb_2733f84f-ecd7-4ea2-b380-a44cc5cde4ec/serve-healthcheck-canary/0.log" Jul 28 07:05:21.612126 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:21.612097 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmp6x_ff03eec4-47e3-4c52-b831-d9ec4233bc9b/kube-rbac-proxy/0.log" Jul 28 07:05:21.637730 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:21.637707 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmp6x_ff03eec4-47e3-4c52-b831-d9ec4233bc9b/exporter/0.log" Jul 28 07:05:21.663396 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:21.663369 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-nmp6x_ff03eec4-47e3-4c52-b831-d9ec4233bc9b/extractor/0.log" Jul 28 07:05:23.782567 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:23.782539 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-jobset-operator_jobset-operator-5bc45f897-fvkpx_09b0f91c-02c3-4d16-93d7-20303dd182ca/jobset-operator/0.log" Jul 28 07:05:25.566797 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:25.566767 2582 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-xtz5m/perf-node-gather-daemonset-br742" Jul 28 07:05:27.846388 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:27.846360 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dtjz8_4dbb63cc-c115-4522-bd50-126d35152d50/migrator/0.log" Jul 28 07:05:27.875408 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:27.875386 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-dtjz8_4dbb63cc-c115-4522-bd50-126d35152d50/graceful-termination/0.log" Jul 28 07:05:28.349824 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:28.349782 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh_3f42843f-843b-4aa4-b2f1-d73766624a7a/kube-storage-version-migrator-operator/1.log" Jul 28 07:05:28.350849 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:28.350810 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-dc9bh_3f42843f-843b-4aa4-b2f1-d73766624a7a/kube-storage-version-migrator-operator/0.log" Jul 28 07:05:30.043147 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.043111 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/kube-multus-additional-cni-plugins/0.log" Jul 28 07:05:30.072062 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.072032 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/egress-router-binary-copy/0.log" Jul 28 07:05:30.098841 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.098818 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/cni-plugins/0.log" Jul 28 07:05:30.123418 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.123392 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/bond-cni-plugin/0.log" Jul 28 07:05:30.148695 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.148669 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/routeoverride-cni/0.log" Jul 28 07:05:30.174318 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.174288 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/whereabouts-cni-bincopy/0.log" Jul 28 07:05:30.204225 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.202205 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-pvqns_59b6f8c0-5381-4d1b-8f5d-c6b99dfac9d4/whereabouts-cni/0.log" Jul 28 07:05:30.239333 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.239308 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-sj4wh_dc965fc2-bbb8-4297-b840-45ea36c987e8/kube-multus/0.log" Jul 28 07:05:30.265544 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.265518 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rhzj_2e0526d0-2279-4ced-b33d-22376dab5808/network-metrics-daemon/0.log" Jul 28 07:05:30.294767 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:30.294738 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-5rhzj_2e0526d0-2279-4ced-b33d-22376dab5808/kube-rbac-proxy/0.log" Jul 28 07:05:31.886726 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:31.886698 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/ovn-controller/0.log" Jul 28 07:05:31.912881 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:31.912852 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/ovn-acl-logging/0.log" Jul 28 07:05:31.943693 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:31.943662 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/kube-rbac-proxy-node/0.log" Jul 28 07:05:31.970282 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:31.970253 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/kube-rbac-proxy-ovn-metrics/0.log" Jul 28 07:05:31.997764 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:31.997740 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/northd/0.log" Jul 28 07:05:32.022051 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:32.022020 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/nbdb/0.log" Jul 28 07:05:32.048766 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:32.048741 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/sbdb/0.log" Jul 28 07:05:32.092333 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:32.092300 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-xtlbk_450c1e35-14f1-4d48-85b9-34121c7aae86/ovnkube-controller/0.log" Jul 28 07:05:33.305462 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:33.305437 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-source-7d88cb55d8-k9sp6_ee1d8b9c-5d4d-4140-8730-3108c85ca32d/check-endpoints/0.log" Jul 28 07:05:33.394091 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:33.394060 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-diagnostics_network-check-target-tz9k8_274704ba-e4c7-40b6-81f4-528ab285079b/network-check-target-container/0.log" Jul 28 07:05:34.536964 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:34.536925 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-operator_iptables-alerter-9kmk7_37a1165a-51de-4346-a3e9-3aa2bafb4b1a/iptables-alerter/0.log" Jul 28 07:05:35.443106 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:35.443075 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-node-tuning-operator_tuned-s7xh6_57bcca38-0be5-406a-953b-604af66d6db2/tuned/0.log" Jul 28 07:05:37.545683 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:37.545644 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-72mwx_03bbf5fd-41d5-40d4-9a6c-4e86af3f4195/cluster-samples-operator/0.log" Jul 28 07:05:37.567847 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:37.567822 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-samples-operator_cluster-samples-operator-6748489656-72mwx_03bbf5fd-41d5-40d4-9a6c-4e86af3f4195/cluster-samples-operator-watch/0.log" Jul 28 07:05:38.797075 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:38.797044 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-22xnm_b9d848e8-a2d5-4d59-9e3d-89e75ec49d16/service-ca-operator/1.log" Jul 28 07:05:38.797731 ip-10-0-138-102 kubenswrapper[2582]: I0728 07:05:38.797715 2582 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-service-ca-operator_service-ca-operator-5d6c75f84f-22xnm_b9d848e8-a2d5-4d59-9e3d-89e75ec49d16/service-ca-operator/0.log"