Jul 02 19:54:49.781136 ip-10-0-139-102 systemd[1]: Starting Kubernetes Kubelet... Jul 02 19:54:50.201356 ip-10-0-139-102 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:54:50.201356 ip-10-0-139-102 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 02 19:54:50.201356 ip-10-0-139-102 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:54:50.201356 ip-10-0-139-102 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 02 19:54:50.201356 ip-10-0-139-102 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 02 19:54:50.202062 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.201351 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208415 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208431 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208435 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208438 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208442 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208445 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.208437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208448 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208451 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208453 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208456 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208459 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208461 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208464 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208466 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208469 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208472 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208475 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208478 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208480 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208483 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208485 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208488 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208490 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208493 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208496 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208498 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.208675 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208501 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208503 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208506 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208508 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208511 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208513 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208517 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208519 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208522 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208524 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208527 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208529 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208531 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208534 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208538 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208541 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208544 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208547 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208549 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208552 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.209172 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208554 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208557 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208559 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208562 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208564 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208567 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208569 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208572 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208574 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208579 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208583 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208586 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208590 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208593 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208596 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208600 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208604 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208609 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208612 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.209670 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208615 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208618 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208621 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208624 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208626 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208628 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208631 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208634 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208638 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208640 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208643 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208645 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208648 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208651 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208653 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208655 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208658 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208660 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208664 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208666 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.210149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208669 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208671 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208674 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208676 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208679 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208682 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208684 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208686 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208689 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208692 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208696 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208699 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208702 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.208705 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209435 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209442 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209446 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209449 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209453 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.210654 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209458 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209462 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209465 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209468 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209471 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209474 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209477 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209480 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209483 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209486 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209488 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209491 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209495 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209497 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209500 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209502 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209505 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209508 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209510 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.211167 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209512 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209515 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209518 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209520 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209523 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209526 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209529 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209532 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209534 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209536 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209541 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209544 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209547 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209550 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209553 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209556 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209559 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209561 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209564 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.211644 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209566 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209569 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209571 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209573 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209576 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209579 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209581 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209584 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209587 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209590 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209592 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209594 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209597 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209600 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209602 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209605 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209608 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209610 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209613 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209615 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.212122 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209618 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209620 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209623 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209625 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209628 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209630 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209633 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209635 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209638 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209640 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209643 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209645 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209648 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209650 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209653 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209655 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209657 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209660 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209662 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209665 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209667 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.212616 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209670 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209672 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209675 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209678 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209680 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209684 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209687 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209690 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209693 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209695 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209699 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209702 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209705 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209707 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.209710 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210111 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210117 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210120 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210122 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210125 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.213130 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210128 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210130 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210133 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210136 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210138 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210141 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210144 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210147 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210149 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210152 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210155 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210158 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210160 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210163 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210165 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210168 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210171 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210173 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210176 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.213617 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210180 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210183 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210186 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210189 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210192 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210194 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210197 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210199 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210202 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210204 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210207 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210211 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210215 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210218 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210221 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210224 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210228 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210231 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210234 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210236 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.214104 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210239 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210241 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210244 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210246 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210248 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210252 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210254 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210257 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210260 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210262 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210266 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210270 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210272 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210275 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210278 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210281 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210283 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210285 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210288 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.214613 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210291 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210293 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210295 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210298 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210301 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210303 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210306 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210308 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210311 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210314 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210317 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210319 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210323 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210325 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210328 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210331 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210333 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210336 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210338 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210341 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.215094 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210344 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210347 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210349 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210352 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210354 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210356 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210359 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210361 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210363 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210366 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210369 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210371 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210373 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210376 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210378 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.210380 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210449 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210455 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210461 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210465 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210469 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 02 19:54:50.215575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210476 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210483 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210488 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210493 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210498 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210502 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210505 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210508 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210511 2568 flags.go:64] FLAG: --cgroup-root="" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210514 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210517 2568 flags.go:64] FLAG: --client-ca-file="" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210521 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210525 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210530 2568 flags.go:64] FLAG: --cluster-domain="" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210533 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210536 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210539 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210542 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210546 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210549 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210552 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210555 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210558 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210561 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 02 19:54:50.216122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210564 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210567 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210570 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210574 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210577 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210580 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210582 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210585 2568 flags.go:64] FLAG: --enable-server="true" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210589 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210593 2568 flags.go:64] FLAG: --event-burst="100" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210596 2568 flags.go:64] FLAG: --event-qps="50" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210599 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210602 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210605 2568 flags.go:64] FLAG: --eviction-hard="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210608 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210611 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210614 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210616 2568 flags.go:64] FLAG: --eviction-soft="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210619 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210622 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210629 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210632 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210635 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210638 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210641 2568 flags.go:64] FLAG: --feature-gates="" Jul 02 19:54:50.216696 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210644 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210647 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210650 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210653 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210656 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210659 2568 flags.go:64] FLAG: --help="false" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210662 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210665 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210668 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210671 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210675 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210678 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210681 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210684 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210686 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210690 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210693 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210696 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210699 2568 flags.go:64] FLAG: --kube-reserved="" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210702 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210704 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210707 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210710 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210713 2568 flags.go:64] FLAG: --lock-file="" Jul 02 19:54:50.217361 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210715 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210718 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210721 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210727 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210731 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210733 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210736 2568 flags.go:64] FLAG: --logging-format="text" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210739 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210742 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210745 2568 flags.go:64] FLAG: --manifest-url="" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210747 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210751 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210754 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210758 2568 flags.go:64] FLAG: --max-pods="110" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210761 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210764 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210767 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210770 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210772 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210775 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210778 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210785 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210788 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210791 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 02 19:54:50.217968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210794 2568 flags.go:64] FLAG: --pod-cidr="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210797 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210802 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210805 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210808 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210811 2568 flags.go:64] FLAG: --port="10250" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210814 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210817 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-01699f4d491a572fc" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210820 2568 flags.go:64] FLAG: --qos-reserved="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210823 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210825 2568 flags.go:64] FLAG: --register-node="true" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210828 2568 flags.go:64] FLAG: --register-with-taints="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210833 2568 flags.go:64] FLAG: --registry-burst="10" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210836 2568 flags.go:64] FLAG: --registry-qps="5" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210839 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210842 2568 flags.go:64] FLAG: --reserved-memory="" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210846 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210849 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210852 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210854 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210857 2568 flags.go:64] FLAG: --runonce="false" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210860 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210863 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210866 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210868 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 02 19:54:50.218563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210871 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210887 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210890 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210893 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210896 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210899 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210902 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210904 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210908 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210910 2568 flags.go:64] FLAG: --system-cgroups="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210913 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210918 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210921 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210924 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210928 2568 flags.go:64] FLAG: --tls-min-version="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210930 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210933 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210936 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210939 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210943 2568 flags.go:64] FLAG: --v="2" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210947 2568 flags.go:64] FLAG: --version="false" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210951 2568 flags.go:64] FLAG: --vmodule="" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210955 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.210958 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211077 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.219187 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211081 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211083 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211086 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211089 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211092 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211094 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211097 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211099 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211102 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211105 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211107 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211109 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211112 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211114 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211117 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211120 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211122 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211125 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211128 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211130 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.219867 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211133 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211135 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211138 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211140 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211143 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211145 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211149 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211152 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211156 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211160 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211163 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211166 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211168 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211171 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211173 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211176 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211179 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211181 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211184 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211186 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.220445 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211189 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211192 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211194 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211197 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211200 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211204 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211208 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211211 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211214 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211217 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211220 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211223 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211225 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211228 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211230 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211233 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211235 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211238 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211242 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.220949 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211245 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211247 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211251 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211255 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211258 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211261 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211264 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211267 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211269 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211271 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211274 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211276 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211279 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211281 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211284 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211286 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211289 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211291 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211295 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.221412 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211297 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211300 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211302 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211305 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211307 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211310 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211312 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211315 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211318 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211320 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211323 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211325 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211329 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211332 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211335 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211337 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211340 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211343 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211345 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.221908 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.211348 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.212015 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.218966 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.218981 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.219000 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.219006 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219059 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219064 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219067 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219070 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219074 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219077 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219079 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219082 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219085 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.222382 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219088 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219090 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219093 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219096 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219098 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219101 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219104 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219107 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219109 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219112 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219115 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219118 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219120 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219122 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219125 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219128 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219132 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219134 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219137 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219139 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.222761 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219143 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219146 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219148 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219151 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219153 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219156 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219158 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219161 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219164 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219166 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219168 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219171 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219174 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219176 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219180 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219183 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219187 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219190 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219193 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.223265 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219196 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219199 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219202 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219205 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219209 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219212 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219215 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219217 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219220 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219223 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219225 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219228 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219230 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219233 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219236 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219239 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219241 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219244 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219246 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219249 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.223716 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219251 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219254 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219257 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219261 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219264 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219267 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219269 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219272 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219274 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219277 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219280 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219283 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219285 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219288 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219290 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219293 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219296 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219299 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219301 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.224291 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219304 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219306 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219308 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219311 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219313 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219316 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219319 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219321 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219324 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219326 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219329 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219333 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.219338 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219442 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219447 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 02 19:54:50.224754 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219450 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219453 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219456 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219459 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219461 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219464 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219467 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219469 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219472 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219474 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219477 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219479 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219482 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219484 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219487 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219490 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219492 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219495 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219497 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219499 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 02 19:54:50.225154 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219502 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219504 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219507 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219509 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219512 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219514 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219517 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219520 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219522 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219525 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219527 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219529 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219532 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219534 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219537 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219539 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219542 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219544 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219547 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219550 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 02 19:54:50.225624 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219552 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219555 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219559 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219563 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219565 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219568 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219571 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219573 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219576 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219578 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219581 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219585 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219588 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219593 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219596 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219599 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219602 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219605 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 02 19:54:50.226149 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219608 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219611 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219614 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219617 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219619 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219622 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219624 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219626 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219629 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219631 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219634 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219636 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219641 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219643 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219646 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219648 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219651 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219653 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219656 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219658 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 02 19:54:50.226620 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219661 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219664 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219666 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219668 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219671 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219674 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219676 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219679 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219681 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219684 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219686 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219689 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219691 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219694 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219697 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219700 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219702 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219705 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 02 19:54:50.227115 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:50.219707 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.219712 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.219803 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.221784 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.223233 2568 server.go:1019] "Starting client certificate rotation" Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.223328 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.223358 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 02 19:54:50.227619 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.226048 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:54:50.228465 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.227510 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 02 19:54:50.234403 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.234386 2568 log.go:25] "Validated CRI v1 runtime API" Jul 02 19:54:50.236499 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.236482 2568 log.go:25] "Validated CRI v1 image API" Jul 02 19:54:50.237275 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.237254 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 02 19:54:50.239791 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.239772 2568 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 ac166e78-4ff4-422d-ba41-6089bb36fe28:/dev/nvme0n1p4 c97f150f-acf2-4b22-8f59-7fdbed045fd9:/dev/nvme0n1p3] Jul 02 19:54:50.239858 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.239790 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 02 19:54:50.244852 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.244747 2568 manager.go:216] Machine: {Timestamp:2026-07-02 19:54:50.243322506 +0000 UTC m=+0.347473599 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3040396 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2e55e950b20a03937e6fd965ccb650 SystemUUID:ec2e55e9-50b2-0a03-937e-6fd965ccb650 BootID:cdfb59db-ba57-40fc-8658-c9d71c41b52f Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:02:76:28:d7:2b Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:02:76:28:d7:2b Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:32:40:8b:d6:ab Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 02 19:54:50.244852 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.244844 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 02 19:54:50.244994 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.244929 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 02 19:54:50.248553 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.248525 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 02 19:54:50.248731 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.248556 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-139-102.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 02 19:54:50.250098 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.250085 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 02 19:54:50.250168 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.250104 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 02 19:54:50.250168 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.250115 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:54:50.250985 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.250973 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 02 19:54:50.252784 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.252772 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 02 19:54:50.253502 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.253488 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:54:50.257129 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257117 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:54:50.257296 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257280 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 02 19:54:50.257330 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257326 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 02 19:54:50.257357 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257339 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 02 19:54:50.257357 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257351 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 02 19:54:50.257407 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257360 2568 kubelet.go:398] "Adding apiserver pod source" Jul 02 19:54:50.257407 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257369 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 02 19:54:50.257737 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257722 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:54:50.257794 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.257743 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 02 19:54:50.260143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.260122 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 02 19:54:50.262850 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.262837 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 02 19:54:50.262905 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.262867 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 02 19:54:50.264894 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264868 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 02 19:54:50.264938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264903 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 02 19:54:50.264938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264909 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 02 19:54:50.264938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264915 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 02 19:54:50.264938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264927 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 02 19:54:50.264938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264932 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264940 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264946 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264952 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264957 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264965 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 02 19:54:50.265068 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.264970 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 02 19:54:50.265854 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.265842 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 02 19:54:50.265901 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.265861 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 02 19:54:50.266753 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.266708 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-139-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 02 19:54:50.266909 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.266887 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 02 19:54:50.269265 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.269249 2568 server.go:1268] "Started kubelet" Jul 02 19:54:50.269346 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.269316 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 02 19:54:50.269462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.269398 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 02 19:54:50.269530 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.269492 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 02 19:54:50.273102 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.272996 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-139-102.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 02 19:54:50.273102 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.272996 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 02 19:54:50.273188 ip-10-0-139-102 systemd[1]: Started Kubernetes Kubelet. Jul 02 19:54:50.274691 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.274666 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 02 19:54:50.275662 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.275641 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 02 19:54:50.280275 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.279175 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-102.ec2.internal.18be9124ed2b6fa2 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-102.ec2.internal,UID:ip-10-0-139-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-139-102.ec2.internal,},FirstTimestamp:2026-07-02 19:54:50.269192098 +0000 UTC m=+0.373343182,LastTimestamp:2026-07-02 19:54:50.269192098 +0000 UTC m=+0.373343182,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-102.ec2.internal,}" Jul 02 19:54:50.282302 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.282280 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 02 19:54:50.282391 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.282284 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 02 19:54:50.282391 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.282386 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.283192 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283178 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 02 19:54:50.283327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283180 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 02 19:54:50.283327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283317 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 02 19:54:50.283327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283321 2568 factory.go:153] Registering CRI-O factory Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283359 2568 factory.go:223] Registration of the crio container factory successfully Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283405 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283412 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283419 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283414 2568 factory.go:55] Registering systemd factory Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283434 2568 factory.go:223] Registration of the systemd container factory successfully Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283451 2568 factory.go:103] Registering Raw factory Jul 02 19:54:50.283509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.283463 2568 manager.go:1196] Started watching for new ooms in manager Jul 02 19:54:50.284082 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.284067 2568 manager.go:349] Starting recovery of all containers Jul 02 19:54:50.289168 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.289141 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 02 19:54:50.289273 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.289220 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-139-102.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 02 19:54:50.294073 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.294060 2568 manager.go:354] Recovery completed Jul 02 19:54:50.295501 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.295484 2568 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jul 02 19:54:50.298231 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.298220 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.300127 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300104 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.300200 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300138 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.300200 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300150 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.300622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300608 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 02 19:54:50.300622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300620 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 02 19:54:50.300699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300624 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.300699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.300634 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 02 19:54:50.301288 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.301274 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.301351 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.301297 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.301351 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.301306 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.302448 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.302014 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-102.ec2.internal.18be9124ef0372ce default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-102.ec2.internal,UID:ip-10-0-139-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-139-102.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-139-102.ec2.internal,},FirstTimestamp:2026-07-02 19:54:50.300125902 +0000 UTC m=+0.404276986,LastTimestamp:2026-07-02 19:54:50.300125902 +0000 UTC m=+0.404276986,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-102.ec2.internal,}" Jul 02 19:54:50.302556 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.302542 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jmbt" Jul 02 19:54:50.302651 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.302638 2568 policy_none.go:49] "None policy: Start" Jul 02 19:54:50.302686 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.302657 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 02 19:54:50.302686 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.302672 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 02 19:54:50.304688 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.304677 2568 policy_none.go:47] "Start" Jul 02 19:54:50.311099 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.310991 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-4jmbt" Jul 02 19:54:50.312307 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.312235 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-139-102.ec2.internal.18be9124ef03b5b5 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-139-102.ec2.internal,UID:ip-10-0-139-102.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-139-102.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-139-102.ec2.internal,},FirstTimestamp:2026-07-02 19:54:50.300143029 +0000 UTC m=+0.404294113,LastTimestamp:2026-07-02 19:54:50.300143029 +0000 UTC m=+0.404294113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-139-102.ec2.internal,}" Jul 02 19:54:50.338586 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.338571 2568 manager.go:337] "Starting Device Plugin manager" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.338605 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.338618 2568 server.go:87] "Starting device plugin registration server" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.338840 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.338851 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.338951 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.339022 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.339030 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.339521 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 02 19:54:50.365554 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.339565 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.390123 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.390100 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 02 19:54:50.391193 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.391174 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 02 19:54:50.391268 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.391216 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 02 19:54:50.391268 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.391241 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 02 19:54:50.391360 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.391279 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 02 19:54:50.393437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.393417 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:54:50.439851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.439833 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.440924 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.440908 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.441011 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.440942 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.441011 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.440958 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.441011 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.440987 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.450415 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.450399 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.450477 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.450418 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-139-102.ec2.internal\": node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.475051 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.475009 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.491354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.491334 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal"] Jul 02 19:54:50.491405 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.491397 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.493630 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.493614 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.493702 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.493640 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.493702 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.493651 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.495570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.495559 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.495688 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.495674 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.495725 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.495719 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.496423 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496408 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.496475 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496438 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.496475 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496448 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.496475 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496468 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.496577 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496477 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.496577 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.496453 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.498507 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.498491 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.498568 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.498523 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:50.499867 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.499850 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:50.499943 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.499891 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:50.499943 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.499904 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:50.533517 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.533497 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-102.ec2.internal\" not found" node="ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.537742 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.537728 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-139-102.ec2.internal\" not found" node="ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.575644 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.575607 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.584339 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.584312 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.584412 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.584348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.584412 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.584365 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c074f33b6433127db8eae8b6a6580-config\") pod \"kube-apiserver-proxy-ip-10-0-139-102.ec2.internal\" (UID: \"086c074f33b6433127db8eae8b6a6580\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.677216 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.677182 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.685067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685034 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.685130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c074f33b6433127db8eae8b6a6580-config\") pod \"kube-apiserver-proxy-ip-10-0-139-102.ec2.internal\" (UID: \"086c074f33b6433127db8eae8b6a6580\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.685130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.685207 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685141 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.685207 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/086c074f33b6433127db8eae8b6a6580-config\") pod \"kube-apiserver-proxy-ip-10-0-139-102.ec2.internal\" (UID: \"086c074f33b6433127db8eae8b6a6580\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.685207 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.685156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/1d8528e9687321442ebada18ec236cc4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal\" (UID: \"1d8528e9687321442ebada18ec236cc4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.778560 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.778489 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.839594 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.839566 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.840811 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:50.840793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:50.879019 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.878992 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:50.986710 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:50.986674 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.089623 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.089542 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.190544 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.190514 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.223629 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.223602 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 02 19:54:51.224140 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.223769 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 02 19:54:51.235786 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.235768 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:54:51.290603 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.290562 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.315980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.315940 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-01 19:49:50 +0000 UTC" deadline="2027-12-25 15:13:22.977237224 +0000 UTC" Jul 02 19:54:51.315980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.315970 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="12979h18m31.661270508s" Jul 02 19:54:51.390873 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.390795 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.491562 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.491524 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.503807 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.503769 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 02 19:54:51.505139 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.505120 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientMemory" Jul 02 19:54:51.505251 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.505156 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasNoDiskPressure" Jul 02 19:54:51.505251 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.505171 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeHasSufficientPID" Jul 02 19:54:51.572417 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:51.572386 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d8528e9687321442ebada18ec236cc4.slice/crio-68b533001ad3ddd1aea3adb37e14e77a2f87411676342f3075a7c52202b7cd1c WatchSource:0}: Error finding container 68b533001ad3ddd1aea3adb37e14e77a2f87411676342f3075a7c52202b7cd1c: Status 404 returned error can't find the container with id 68b533001ad3ddd1aea3adb37e14e77a2f87411676342f3075a7c52202b7cd1c Jul 02 19:54:51.579733 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.579719 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:54:51.585810 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:51.585787 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod086c074f33b6433127db8eae8b6a6580.slice/crio-5ffec406994e14faf4da0e29df46031445bf9d0640da0678739db85017796cf5 WatchSource:0}: Error finding container 5ffec406994e14faf4da0e29df46031445bf9d0640da0678739db85017796cf5: Status 404 returned error can't find the container with id 5ffec406994e14faf4da0e29df46031445bf9d0640da0678739db85017796cf5 Jul 02 19:54:51.592029 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.592008 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.693192 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.693113 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.730768 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.730746 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:54:51.794162 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:51.794126 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-139-102.ec2.internal\" not found" Jul 02 19:54:51.794466 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.794450 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:54:51.883831 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.883798 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" Jul 02 19:54:51.894448 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.894426 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:54:51.895544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.895527 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" Jul 02 19:54:51.907662 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:51.907644 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 02 19:54:52.258567 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.258539 2568 apiserver.go:52] "Watching apiserver" Jul 02 19:54:52.268393 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.268371 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 02 19:54:52.269395 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.269366 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal","openshift-multus/multus-additional-cni-plugins-clgx2","kube-system/global-pull-secret-syncer-7p8d4","openshift-multus/multus-dkn4d","openshift-multus/network-metrics-daemon-tnhmx","openshift-network-diagnostics/network-check-target-mtr5g","openshift-network-operator/iptables-alerter-8jwc4","openshift-ovn-kubernetes/ovnkube-node-nn5g4","kube-system/konnectivity-agent-mlvml","kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54","openshift-cluster-node-tuning-operator/tuned-6gsn9","openshift-dns/node-resolver-9hgnj","openshift-image-registry/node-ca-wpdsk"] Jul 02 19:54:52.272104 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.272082 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.274456 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.274433 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.275200 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.275182 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.275307 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.275248 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-72h2g\"" Jul 02 19:54:52.275307 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.275258 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.275421 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.275348 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 02 19:54:52.276869 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.276797 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.277192 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.277125 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.277192 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.277185 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4g4xl\"" Jul 02 19:54:52.277360 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.277266 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 02 19:54:52.277422 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.277357 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.279071 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.279045 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-hl6zc\"" Jul 02 19:54:52.279307 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.279261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.279659 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.279641 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.279764 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.279754 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.281514 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.281492 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.281736 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.281718 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.282044 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.282024 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.282122 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.282099 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-drs7l\"" Jul 02 19:54:52.282192 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.282119 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 02 19:54:52.282380 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.282360 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 02 19:54:52.282525 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.282503 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 02 19:54:52.284260 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.284041 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 02 19:54:52.284424 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.284404 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 02 19:54:52.284514 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.284416 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fz5kb\"" Jul 02 19:54:52.284639 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.284622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:52.284728 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.284704 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:54:52.287187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.287168 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.287290 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.287237 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:54:52.290148 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.290120 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.290242 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.290183 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:54:52.293320 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.293074 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.296862 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-2whrm\"" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.296923 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.296930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-conf-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.296986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297015 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-k8s-cni-cncf-io\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297081 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-kubelet\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297121 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-etc-kubernetes\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj27d\" (UniqueName: \"kubernetes.io/projected/b0ceba08-a7bd-41b7-b73e-734f561d7853-kube-api-access-kj27d\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297171 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89f43f81-c546-4f28-98f0-64793f0c07c5-konnectivity-ca\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.297230 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297230 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ncnd7\" (UniqueName: \"kubernetes.io/projected/e4775105-1f50-4ffe-8d19-068fa4e85e99-kube-api-access-ncnd7\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297265 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297279 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-socket-dir-parent\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-sys-fs\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4775105-1f50-4ffe-8d19-068fa4e85e99-iptables-alerter-script\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297436 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4775105-1f50-4ffe-8d19-068fa4e85e99-host-slash\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-registration-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7ccxr\" (UniqueName: \"kubernetes.io/projected/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kube-api-access-7ccxr\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c467b03d-d81a-462c-86fa-4fa553d71630-hosts-file\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297629 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89f43f81-c546-4f28-98f0-64793f0c07c5-agent-certs\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.297828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.297751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-hostroot\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298119 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mk84x\" (UniqueName: \"kubernetes.io/projected/c467b03d-d81a-462c-86fa-4fa553d71630-kube-api-access-mk84x\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298159 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-cni-binary-copy\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298186 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-multus-certs\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298224 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-socket-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-cnibin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298284 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-device-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c467b03d-d81a-462c-86fa-4fa553d71630-tmp-dir\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-system-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-netns\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.298468 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298449 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-bin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.299085 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-daemon-config\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.299085 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-os-release\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.299085 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.298570 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-multus\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.299240 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.299114 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.300906 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.300874 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.302733 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.301877 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 02 19:54:52.302733 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.301993 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.302733 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.302250 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-x9wc8\"" Jul 02 19:54:52.304246 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.304224 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 02 19:54:52.304820 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.304803 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 02 19:54:52.305692 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.305671 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.306778 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.305932 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.306778 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.306191 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.306778 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.306259 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ztthc\"" Jul 02 19:54:52.306778 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.306723 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 02 19:54:52.306778 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.306745 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 02 19:54:52.309338 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.309318 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 02 19:54:52.309423 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.309369 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-7jcxm\"" Jul 02 19:54:52.309536 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.309515 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 02 19:54:52.310020 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.310002 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 02 19:54:52.321700 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.321675 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q94ld" Jul 02 19:54:52.327824 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.327793 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q94ld" Jul 02 19:54:52.385276 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.385251 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 02 19:54:52.397268 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.397214 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" event={"ID":"086c074f33b6433127db8eae8b6a6580","Type":"ContainerStarted","Data":"5ffec406994e14faf4da0e29df46031445bf9d0640da0678739db85017796cf5"} Jul 02 19:54:52.399076 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399047 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c467b03d-d81a-462c-86fa-4fa553d71630-tmp-dir\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.399190 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-bin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399190 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399146 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-bin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399190 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399185 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-env-overrides\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399213 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399238 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-host\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399263 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-os-release\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-netd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399312 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hsphz\" (UniqueName: \"kubernetes.io/projected/77202c31-ab05-48c8-a4d9-4903873af2b7-kube-api-access-hsphz\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.399354 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399337 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399387 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-kubelet\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c467b03d-d81a-462c-86fa-4fa553d71630-tmp-dir\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-etc-kubernetes\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-config\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399497 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hmjk\" (UniqueName: \"kubernetes.io/projected/cfa25102-4fb7-4fec-8398-30225416c000-kube-api-access-5hmjk\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-etc-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399572 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399578 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-os-release\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7dm5d\" (UniqueName: \"kubernetes.io/projected/3a939587-2493-4373-a746-f3aa3311ffb0-kube-api-access-7dm5d\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-sys-fs\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399639 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-etc-kubernetes\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-var-lib-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.399668 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-bin\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4775105-1f50-4ffe-8d19-068fa4e85e99-host-slash\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-registration-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399766 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-etc-selinux\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c467b03d-d81a-462c-86fa-4fa553d71630-hosts-file\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89f43f81-c546-4f28-98f0-64793f0c07c5-agent-certs\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-kubelet\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77202c31-ab05-48c8-a4d9-4903873af2b7-serviceca\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-dbus\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399935 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-hostroot\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399949 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-kubelet\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.399976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-multus-certs\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400021 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-netns\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400051 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e4775105-1f50-4ffe-8d19-068fa4e85e99-host-slash\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400111 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-registration-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400127 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-hostroot\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.400501 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400166 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/c467b03d-d81a-462c-86fa-4fa553d71630-hosts-file\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400195 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-lib-modules\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-socket-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-systemd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400412 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/24d84617-286b-40c0-a763-ea79436791e6-kube-api-access-ftqz7\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400450 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-run\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400493 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-device-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400508 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-system-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400544 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-netns\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-daemon-config\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400714 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-log-socket\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-script-lib\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400778 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-modprobe-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.401371 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400814 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-multus\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400840 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-conf-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-ovn\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400911 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77202c31-ab05-48c8-a4d9-4903873af2b7-host\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-conf\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-systemd\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-etc-tuned\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401070 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-k8s-cni-cncf-io\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj27d\" (UniqueName: \"kubernetes.io/projected/b0ceba08-a7bd-41b7-b73e-734f561d7853-kube-api-access-kj27d\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89f43f81-c546-4f28-98f0-64793f0c07c5-konnectivity-ca\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401211 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-sys\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401243 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ncnd7\" (UniqueName: \"kubernetes.io/projected/e4775105-1f50-4ffe-8d19-068fa4e85e99-kube-api-access-ncnd7\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401277 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-socket-dir-parent\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-slash\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401334 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-kubelet-config\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.402250 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-kubernetes\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401509 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-tmp\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401542 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24d84617-286b-40c0-a763-ea79436791e6-ovn-node-metrics-cert\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401569 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-system-cni-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-os-release\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401624 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401650 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-var-lib-kubelet\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4775105-1f50-4ffe-8d19-068fa4e85e99-iptables-alerter-script\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401707 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7ccxr\" (UniqueName: \"kubernetes.io/projected/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kube-api-access-7ccxr\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-node-log\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2t58b\" (UniqueName: \"kubernetes.io/projected/3ab9d5ec-c35c-404d-9dfa-d841531665b5-kube-api-access-2t58b\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401862 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mk84x\" (UniqueName: \"kubernetes.io/projected/c467b03d-d81a-462c-86fa-4fa553d71630-kube-api-access-mk84x\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-cni-binary-copy\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-systemd-units\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.401989 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-cnibin\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.403133 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-cnibin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402099 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysconfig\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402127 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402730 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-daemon-config\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-sys-fs\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.402911 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-socket-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403287 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-device-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403343 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-system-cni-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403381 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-netns\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403421 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-var-lib-cni-multus\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403453 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-conf-dir\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.403975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.403501 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-k8s-cni-cncf-io\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.404470 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.404347 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/89f43f81-c546-4f28-98f0-64793f0c07c5-konnectivity-ca\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.404714 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-multus-socket-dir-parent\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.404989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" event={"ID":"1d8528e9687321442ebada18ec236cc4","Type":"ContainerStarted","Data":"68b533001ad3ddd1aea3adb37e14e77a2f87411676342f3075a7c52202b7cd1c"} Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.400168 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-host-run-multus-certs\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.405385 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.405470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b0ceba08-a7bd-41b7-b73e-734f561d7853-cnibin\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.406120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.406074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b0ceba08-a7bd-41b7-b73e-734f561d7853-cni-binary-copy\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.406522 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.406297 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/e4775105-1f50-4ffe-8d19-068fa4e85e99-iptables-alerter-script\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.410226 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.409804 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:52.410226 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.409827 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:52.410226 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.409840 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:52.410226 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.409914 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:52.909890899 +0000 UTC m=+3.014041974 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:52.410226 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.410126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/89f43f81-c546-4f28-98f0-64793f0c07c5-agent-certs\") pod \"konnectivity-agent-mlvml\" (UID: \"89f43f81-c546-4f28-98f0-64793f0c07c5\") " pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.415227 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.415203 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj27d\" (UniqueName: \"kubernetes.io/projected/b0ceba08-a7bd-41b7-b73e-734f561d7853-kube-api-access-kj27d\") pod \"multus-dkn4d\" (UID: \"b0ceba08-a7bd-41b7-b73e-734f561d7853\") " pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.415929 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.415897 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7ccxr\" (UniqueName: \"kubernetes.io/projected/c60d4f4b-62a2-4b56-ab88-b41c3eed3af4-kube-api-access-7ccxr\") pod \"aws-ebs-csi-driver-node-m9n54\" (UID: \"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.417615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.417587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mk84x\" (UniqueName: \"kubernetes.io/projected/c467b03d-d81a-462c-86fa-4fa553d71630-kube-api-access-mk84x\") pod \"node-resolver-9hgnj\" (UID: \"c467b03d-d81a-462c-86fa-4fa553d71630\") " pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.421000 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.420977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ncnd7\" (UniqueName: \"kubernetes.io/projected/e4775105-1f50-4ffe-8d19-068fa4e85e99-kube-api-access-ncnd7\") pod \"iptables-alerter-8jwc4\" (UID: \"e4775105-1f50-4ffe-8d19-068fa4e85e99\") " pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.503222 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-systemd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503364 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503242 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/24d84617-286b-40c0-a763-ea79436791e6-kube-api-access-ftqz7\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503364 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503285 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-run\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.503364 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503353 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-log-socket\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503377 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-run\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-script-lib\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503452 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-modprobe-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503472 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-systemd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-ovn\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503519 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77202c31-ab05-48c8-a4d9-4903873af2b7-host\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.503544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503532 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-log-socket\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-conf\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503661 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-ovn\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503701 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-systemd\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-etc-tuned\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503792 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503847 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-sys\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503870 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysctl-conf\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-slash\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503885 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-systemd\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.503964 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/77202c31-ab05-48c8-a4d9-4903873af2b7-host\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.504013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504016 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-slash\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504037 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-sys\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504188 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-modprobe-d\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-kubelet-config\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-kubernetes\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504396 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-kubernetes\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504457 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-tmp\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504558 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-kubelet-config\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24d84617-286b-40c0-a763-ea79436791e6-ovn-node-metrics-cert\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504597 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.504683 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.504656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-system-cni-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505679 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-os-release\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505710 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-var-lib-kubelet\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505760 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-node-log\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2t58b\" (UniqueName: \"kubernetes.io/projected/3ab9d5ec-c35c-404d-9dfa-d841531665b5-kube-api-access-2t58b\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505809 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-systemd-units\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-cnibin\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505855 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505879 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysconfig\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505902 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-env-overrides\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-host\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.506041 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506015 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-netd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506055 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hsphz\" (UniqueName: \"kubernetes.io/projected/77202c31-ab05-48c8-a4d9-4903873af2b7-kube-api-access-hsphz\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506108 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-config\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506134 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hmjk\" (UniqueName: \"kubernetes.io/projected/cfa25102-4fb7-4fec-8398-30225416c000-kube-api-access-5hmjk\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-etc-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505318 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-system-cni-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506226 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7dm5d\" (UniqueName: \"kubernetes.io/projected/3a939587-2493-4373-a746-f3aa3311ffb0-kube-api-access-7dm5d\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506259 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-var-lib-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506284 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-bin\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506293 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-os-release\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.505646 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-script-lib\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-kubelet\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-kubelet\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506464 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-etc-sysconfig\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.506795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77202c31-ab05-48c8-a4d9-4903873af2b7-serviceca\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-dbus\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.506562 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506598 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-netns\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.506629 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:53.006610329 +0000 UTC m=+3.110761421 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506645 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-systemd-units\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506779 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-var-lib-kubelet\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506816 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3a939587-2493-4373-a746-f3aa3311ffb0-cnibin\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506878 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-node-log\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507028 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/33862b5d-5eb7-44b6-936b-fb288c0368c2-dbus\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507048 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-env-overrides\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507084 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-etc-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507114 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-ovn-kubernetes\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/77202c31-ab05-48c8-a4d9-4903873af2b7-serviceca\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.506566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-run-netns\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.507699 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507353 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-bin\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507424 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-run-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507467 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-var-lib-openvswitch\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-lib-modules\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507600 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-binary-copy\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.507689 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-lib-modules\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507729 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cfa25102-4fb7-4fec-8398-30225416c000-host\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.507748 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:53.007731595 +0000 UTC m=+3.111882668 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507776 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/24d84617-286b-40c0-a763-ea79436791e6-host-cni-netd\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.507787 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3a939587-2493-4373-a746-f3aa3311ffb0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.508320 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/24d84617-286b-40c0-a763-ea79436791e6-ovnkube-config\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.508719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.508494 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-tmp\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.509606 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.509580 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/cfa25102-4fb7-4fec-8398-30225416c000-etc-tuned\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.510556 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.510479 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/24d84617-286b-40c0-a763-ea79436791e6-ovn-node-metrics-cert\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.514365 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.514338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftqz7\" (UniqueName: \"kubernetes.io/projected/24d84617-286b-40c0-a763-ea79436791e6-kube-api-access-ftqz7\") pod \"ovnkube-node-nn5g4\" (UID: \"24d84617-286b-40c0-a763-ea79436791e6\") " pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.516044 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.516021 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2t58b\" (UniqueName: \"kubernetes.io/projected/3ab9d5ec-c35c-404d-9dfa-d841531665b5-kube-api-access-2t58b\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:52.519298 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.519251 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7dm5d\" (UniqueName: \"kubernetes.io/projected/3a939587-2493-4373-a746-f3aa3311ffb0-kube-api-access-7dm5d\") pod \"multus-additional-cni-plugins-clgx2\" (UID: \"3a939587-2493-4373-a746-f3aa3311ffb0\") " pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.520388 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.520341 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hmjk\" (UniqueName: \"kubernetes.io/projected/cfa25102-4fb7-4fec-8398-30225416c000-kube-api-access-5hmjk\") pod \"tuned-6gsn9\" (UID: \"cfa25102-4fb7-4fec-8398-30225416c000\") " pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.521418 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.521393 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hsphz\" (UniqueName: \"kubernetes.io/projected/77202c31-ab05-48c8-a4d9-4903873af2b7-kube-api-access-hsphz\") pod \"node-ca-wpdsk\" (UID: \"77202c31-ab05-48c8-a4d9-4903873af2b7\") " pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.586745 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.586722 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8jwc4" Jul 02 19:54:52.592609 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.592585 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 02 19:54:52.597035 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.597013 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9hgnj" Jul 02 19:54:52.597598 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.597568 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode4775105_1f50_4ffe_8d19_068fa4e85e99.slice/crio-52d540cce5c968ff5bfb093975ef19b770e796c7eb45ea541284ed6b96cb953b WatchSource:0}: Error finding container 52d540cce5c968ff5bfb093975ef19b770e796c7eb45ea541284ed6b96cb953b: Status 404 returned error can't find the container with id 52d540cce5c968ff5bfb093975ef19b770e796c7eb45ea541284ed6b96cb953b Jul 02 19:54:52.608020 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.607990 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc467b03d_d81a_462c_86fa_4fa553d71630.slice/crio-4b3b3bd9d296e7f10727937b7f24608ddbd6d95b89a6c400c728f14cfd46a3b3 WatchSource:0}: Error finding container 4b3b3bd9d296e7f10727937b7f24608ddbd6d95b89a6c400c728f14cfd46a3b3: Status 404 returned error can't find the container with id 4b3b3bd9d296e7f10727937b7f24608ddbd6d95b89a6c400c728f14cfd46a3b3 Jul 02 19:54:52.608877 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.608735 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" Jul 02 19:54:52.618939 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.618912 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-dkn4d" Jul 02 19:54:52.619805 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.619777 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc60d4f4b_62a2_4b56_ab88_b41c3eed3af4.slice/crio-36255f615f56380778f53307db477fd57a422d3537ab629e1c6ed263d9f0006a WatchSource:0}: Error finding container 36255f615f56380778f53307db477fd57a422d3537ab629e1c6ed263d9f0006a: Status 404 returned error can't find the container with id 36255f615f56380778f53307db477fd57a422d3537ab629e1c6ed263d9f0006a Jul 02 19:54:52.626274 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.626110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:54:52.629501 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.629463 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ceba08_a7bd_41b7_b73e_734f561d7853.slice/crio-baa1e63fac4467d193be331561fd02c2573bc0ee4d59a2288e53f77a3dcdce7a WatchSource:0}: Error finding container baa1e63fac4467d193be331561fd02c2573bc0ee4d59a2288e53f77a3dcdce7a: Status 404 returned error can't find the container with id baa1e63fac4467d193be331561fd02c2573bc0ee4d59a2288e53f77a3dcdce7a Jul 02 19:54:52.636700 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.636679 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-clgx2" Jul 02 19:54:52.637305 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.637280 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89f43f81_c546_4f28_98f0_64793f0c07c5.slice/crio-ddbeae7706443e0a7a2b81866fd940f64cfcf3a1c5496a0c2eafb2e887773ba9 WatchSource:0}: Error finding container ddbeae7706443e0a7a2b81866fd940f64cfcf3a1c5496a0c2eafb2e887773ba9: Status 404 returned error can't find the container with id ddbeae7706443e0a7a2b81866fd940f64cfcf3a1c5496a0c2eafb2e887773ba9 Jul 02 19:54:52.644798 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.644763 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" Jul 02 19:54:52.648289 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.647921 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a939587_2493_4373_a746_f3aa3311ffb0.slice/crio-19d1a1392c918e8aba6a85d96d03b2dc8ec3986a69eb39ee86c98368960306fc WatchSource:0}: Error finding container 19d1a1392c918e8aba6a85d96d03b2dc8ec3986a69eb39ee86c98368960306fc: Status 404 returned error can't find the container with id 19d1a1392c918e8aba6a85d96d03b2dc8ec3986a69eb39ee86c98368960306fc Jul 02 19:54:52.651921 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.651784 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:54:52.655728 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.655698 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfa25102_4fb7_4fec_8398_30225416c000.slice/crio-cadce3e170dbf8c11a07f542b2f5efdc7f9bce8b4682b60e643d794ea191dfa4 WatchSource:0}: Error finding container cadce3e170dbf8c11a07f542b2f5efdc7f9bce8b4682b60e643d794ea191dfa4: Status 404 returned error can't find the container with id cadce3e170dbf8c11a07f542b2f5efdc7f9bce8b4682b60e643d794ea191dfa4 Jul 02 19:54:52.658553 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.658331 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wpdsk" Jul 02 19:54:52.662376 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.662287 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24d84617_286b_40c0_a763_ea79436791e6.slice/crio-d83d44c7ae0ce9b81292eb5e8ab4688d25ebb6184916d299cb9f787ff585fa1a WatchSource:0}: Error finding container d83d44c7ae0ce9b81292eb5e8ab4688d25ebb6184916d299cb9f787ff585fa1a: Status 404 returned error can't find the container with id d83d44c7ae0ce9b81292eb5e8ab4688d25ebb6184916d299cb9f787ff585fa1a Jul 02 19:54:52.670060 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:54:52.670037 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77202c31_ab05_48c8_a4d9_4903873af2b7.slice/crio-35577ae304b25035526dcc32337b97bb66fecf28db6a106a3e445100d184f14e WatchSource:0}: Error finding container 35577ae304b25035526dcc32337b97bb66fecf28db6a106a3e445100d184f14e: Status 404 returned error can't find the container with id 35577ae304b25035526dcc32337b97bb66fecf28db6a106a3e445100d184f14e Jul 02 19:54:52.910395 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:52.910296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:52.910567 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.910526 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:52.910567 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.910555 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:52.910745 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.910571 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:52.910745 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:52.910639 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:53.91061827 +0000 UTC m=+4.014769346 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:53.011543 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.011507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:53.011734 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.011617 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:53.011734 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.011691 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:53.011836 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.011748 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:53.011836 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.011764 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:54.01174713 +0000 UTC m=+4.115898213 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:53.011836 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.011804 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:54.011785634 +0000 UTC m=+4.115936714 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:53.331387 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.331294 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:49:52 +0000 UTC" deadline="2028-02-06 01:55:13.491376405 +0000 UTC" Jul 02 19:54:53.331387 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.331333 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13998h0m20.160048383s" Jul 02 19:54:53.391968 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.391936 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:53.392136 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.392083 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:54:53.408313 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.408267 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"d83d44c7ae0ce9b81292eb5e8ab4688d25ebb6184916d299cb9f787ff585fa1a"} Jul 02 19:54:53.409657 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.409632 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlvml" event={"ID":"89f43f81-c546-4f28-98f0-64793f0c07c5","Type":"ContainerStarted","Data":"ddbeae7706443e0a7a2b81866fd940f64cfcf3a1c5496a0c2eafb2e887773ba9"} Jul 02 19:54:53.411023 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.410996 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hgnj" event={"ID":"c467b03d-d81a-462c-86fa-4fa553d71630","Type":"ContainerStarted","Data":"4b3b3bd9d296e7f10727937b7f24608ddbd6d95b89a6c400c728f14cfd46a3b3"} Jul 02 19:54:53.412317 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.412290 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jwc4" event={"ID":"e4775105-1f50-4ffe-8d19-068fa4e85e99","Type":"ContainerStarted","Data":"52d540cce5c968ff5bfb093975ef19b770e796c7eb45ea541284ed6b96cb953b"} Jul 02 19:54:53.413743 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.413715 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" event={"ID":"cfa25102-4fb7-4fec-8398-30225416c000","Type":"ContainerStarted","Data":"cadce3e170dbf8c11a07f542b2f5efdc7f9bce8b4682b60e643d794ea191dfa4"} Jul 02 19:54:53.415009 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.414978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerStarted","Data":"19d1a1392c918e8aba6a85d96d03b2dc8ec3986a69eb39ee86c98368960306fc"} Jul 02 19:54:53.416333 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.416313 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dkn4d" event={"ID":"b0ceba08-a7bd-41b7-b73e-734f561d7853","Type":"ContainerStarted","Data":"baa1e63fac4467d193be331561fd02c2573bc0ee4d59a2288e53f77a3dcdce7a"} Jul 02 19:54:53.417774 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.417750 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" event={"ID":"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4","Type":"ContainerStarted","Data":"36255f615f56380778f53307db477fd57a422d3537ab629e1c6ed263d9f0006a"} Jul 02 19:54:53.418901 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.418865 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpdsk" event={"ID":"77202c31-ab05-48c8-a4d9-4903873af2b7","Type":"ContainerStarted","Data":"35577ae304b25035526dcc32337b97bb66fecf28db6a106a3e445100d184f14e"} Jul 02 19:54:53.920080 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:53.919336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:53.920080 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.919528 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:53.920080 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.919548 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:53.920080 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.919585 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:53.920080 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:53.919645 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:55.919627648 +0000 UTC m=+6.023778726 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.019740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.019794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.019941 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.020007 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:56.019987808 +0000 UTC m=+6.124138884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.020422 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:54.020526 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.020478 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:56.020462247 +0000 UTC m=+6.124613322 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:54.332174 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.331916 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-01 19:49:52 +0000 UTC" deadline="2028-01-15 20:48:26.096884287 +0000 UTC" Jul 02 19:54:54.332174 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.332159 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13488h53m31.764729768s" Jul 02 19:54:54.394208 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.394180 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:54.394388 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.394319 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:54:54.394719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.394702 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:54.394815 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:54.394792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:54:54.427109 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:54.426463 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" event={"ID":"086c074f33b6433127db8eae8b6a6580","Type":"ContainerStarted","Data":"1d58a672a239dc8d83e77fdc72d5e8a630f8734270fe9d0b8a176096a765a831"} Jul 02 19:54:55.391927 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:55.391439 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:55.391927 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:55.391561 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:54:55.441466 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:55.441430 2568 generic.go:356] "Generic (PLEG): container finished" podID="1d8528e9687321442ebada18ec236cc4" containerID="813ac465ead6cb629feae5294748bc61b4037bebbf44b4eb93a2da6be68ee595" exitCode=0 Jul 02 19:54:55.441947 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:55.441921 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" event={"ID":"1d8528e9687321442ebada18ec236cc4","Type":"ContainerDied","Data":"813ac465ead6cb629feae5294748bc61b4037bebbf44b4eb93a2da6be68ee595"} Jul 02 19:54:55.458765 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:55.458484 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-139-102.ec2.internal" podStartSLOduration=3.458457421 podStartE2EDuration="3.458457421s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:54:54.443187134 +0000 UTC m=+4.547338227" watchObservedRunningTime="2026-07-02 19:54:55.458457421 +0000 UTC m=+5.562608516" Jul 02 19:54:55.940194 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:55.940159 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:55.940514 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:55.940320 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:55.940514 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:55.940342 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:55.940514 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:55.940355 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:55.940514 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:55.940406 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:54:59.940389489 +0000 UTC m=+10.044540564 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:56.041177 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:56.041127 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:56.041177 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:56.041183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:56.041478 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.041355 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:56.041478 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.041418 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:00.041400068 +0000 UTC m=+10.145551163 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:54:56.041891 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.041780 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:56.041891 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.041849 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:00.041830332 +0000 UTC m=+10.145981420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:54:56.392400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:56.392321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:56.392400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:56.392351 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:56.393012 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.392471 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:54:56.393012 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:56.392653 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:54:57.392285 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:57.392251 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:57.392460 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:57.392420 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:54:58.394151 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:58.394094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:58.394592 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:58.394212 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:54:58.394592 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:58.394283 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:54:58.394592 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:58.394402 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:54:59.392303 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:59.392256 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:54:59.392464 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:59.392408 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:54:59.976027 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:54:59.975954 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:54:59.976510 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:59.976108 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:54:59.976510 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:59.976135 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:54:59.976510 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:59.976149 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:54:59.976510 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:54:59.976200 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:07.976187266 +0000 UTC m=+18.080338341 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:00.076786 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:00.076843 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.077002 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.077062 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:08.077045 +0000 UTC m=+18.181196078 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.077450 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:00.077537 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.077504 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:08.07748633 +0000 UTC m=+18.181637407 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:00.391952 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:00.391552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:00.392742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:00.392652 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:00.392894 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.392770 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:00.393232 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:00.393182 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:01.392395 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:01.392364 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:01.392848 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:01.392494 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:02.392445 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:02.392413 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:02.392923 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:02.392540 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:02.392923 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:02.392424 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:02.392923 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:02.392697 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:03.391703 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:03.391671 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:03.391910 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:03.391790 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:04.391615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:04.391580 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:04.392167 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:04.391596 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:04.392167 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:04.391724 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:04.392167 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:04.391848 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:05.391454 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:05.391420 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:05.391610 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:05.391536 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:06.391947 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:06.391907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:06.392389 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:06.391907 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:06.392389 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:06.392050 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:06.392389 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:06.392098 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:07.391813 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:07.391741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:07.392010 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:07.391854 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:08.033630 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:08.033592 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:08.033911 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.033787 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:55:08.033911 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.033817 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:55:08.033911 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.033830 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:55:08.033911 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.033906 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.033888874 +0000 UTC m=+34.138039968 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:55:08.134698 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:08.134662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:08.134871 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:08.134712 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:08.134871 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.134763 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:08.134871 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.134800 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:08.134871 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.134830 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.134810257 +0000 UTC m=+34.238961351 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:08.134871 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.134847 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.134840203 +0000 UTC m=+34.238991274 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:08.392191 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:08.392093 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:08.392626 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.392223 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:08.392626 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:08.392317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:08.392817 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:08.392782 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:09.391500 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:09.391470 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:09.391678 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:09.391583 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:10.392509 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:10.392476 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:10.392975 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:10.392556 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:10.392975 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:10.392575 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:10.392975 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:10.392661 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:11.391974 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:11.391944 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:11.392113 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:11.392058 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:12.391955 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.391699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:12.392582 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.391743 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:12.392582 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:12.391998 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:12.392582 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:12.392060 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:12.473984 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.473955 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mlvml" event={"ID":"89f43f81-c546-4f28-98f0-64793f0c07c5","Type":"ContainerStarted","Data":"f25415389eeb377ff28963b8b9edb5f2a39b8bfbe7ee1c5d9882f6cb56c09133"} Jul 02 19:55:12.475336 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.475307 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9hgnj" event={"ID":"c467b03d-d81a-462c-86fa-4fa553d71630","Type":"ContainerStarted","Data":"eaa47370e159e87dd25f694908d5584fb96b551dec9d4013c658d291e579281b"} Jul 02 19:55:12.476842 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.476823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" event={"ID":"1d8528e9687321442ebada18ec236cc4","Type":"ContainerStarted","Data":"d37a369bfa69b085e0a3a06e19c401a01cc3701c7bfb218ff35add43e3e70166"} Jul 02 19:55:12.481072 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.481045 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" event={"ID":"cfa25102-4fb7-4fec-8398-30225416c000","Type":"ContainerStarted","Data":"45709ab3078de37ae6a36c2c5be814a2d231306b361124bd62fe23162ffa98ff"} Jul 02 19:55:12.482525 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.482504 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="d3b6a747cbe301d96329446b7959e5c5c8abbbf8303f05f018d1e8af85928b74" exitCode=0 Jul 02 19:55:12.482606 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.482571 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"d3b6a747cbe301d96329446b7959e5c5c8abbbf8303f05f018d1e8af85928b74"} Jul 02 19:55:12.484004 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.483983 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-dkn4d" event={"ID":"b0ceba08-a7bd-41b7-b73e-734f561d7853","Type":"ContainerStarted","Data":"061b1d0fcb11bdb7f145b19bb0b1006f7e8e9f68c24ba5723691be462d2f7988"} Jul 02 19:55:12.485226 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.485203 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" event={"ID":"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4","Type":"ContainerStarted","Data":"56ecfd009c3042fd9823193b7cd12240ddc573f209a642a2524e8982153102ca"} Jul 02 19:55:12.488482 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.488455 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wpdsk" event={"ID":"77202c31-ab05-48c8-a4d9-4903873af2b7","Type":"ContainerStarted","Data":"80532d34bc0d359a8c52ca17811c500594e0b758e426460c1174332f2f457d0e"} Jul 02 19:55:12.489444 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.489407 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mlvml" podStartSLOduration=3.9722035030000002 podStartE2EDuration="22.489395473s" totalImagesPullingTime="18.51719197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.489062808 +0000 UTC m=+22.593213903" watchObservedRunningTime="2026-07-02 19:55:12.489395473 +0000 UTC m=+22.593546566" Jul 02 19:55:12.491378 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491348 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"f2976a82624d43faa51720276bb8fc583ea59244a78124f6f047cb0cc9c542c4"} Jul 02 19:55:12.491484 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491425 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"3791f1e087ab060f482c8a22e2c51f2075e44529d16dcf7957f569b8a91382a7"} Jul 02 19:55:12.491484 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491477 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"54bfbb7f5912d973434435a53cccc6a9cff6d91af154ef7ce4950efd06d28af2"} Jul 02 19:55:12.491594 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491524 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"856aca1080194e60f1cd07d03aa4f4145917ca1ac7388628d8aa2f06c69bd6f5"} Jul 02 19:55:12.491594 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491570 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"99ad88fd552343b313730fcee3f0acc4b9fae6b11b7b162cbcc5e270a566a347"} Jul 02 19:55:12.491688 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.491618 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"c034a3ce27158d59298fcd0d3453cd670d8e04e862931edc3164ca48c8e4f2cf"} Jul 02 19:55:12.505328 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.505282 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-dkn4d" podStartSLOduration=3.628793106 podStartE2EDuration="22.505258743s" totalImagesPullingTime="18.876465637s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.504981438 +0000 UTC m=+22.609132533" watchObservedRunningTime="2026-07-02 19:55:12.505258743 +0000 UTC m=+22.609409837" Jul 02 19:55:12.539539 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.539492 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-6gsn9" podStartSLOduration=2.7245547009999997 podStartE2EDuration="21.539474432s" totalImagesPullingTime="18.814919731s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.539378033 +0000 UTC m=+22.643529127" watchObservedRunningTime="2026-07-02 19:55:12.539474432 +0000 UTC m=+22.643625526" Jul 02 19:55:12.555511 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.555466 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9hgnj" podStartSLOduration=4.009354607 podStartE2EDuration="22.555454144s" totalImagesPullingTime="18.546099537s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.5550482 +0000 UTC m=+22.659199293" watchObservedRunningTime="2026-07-02 19:55:12.555454144 +0000 UTC m=+22.659605238" Jul 02 19:55:12.579561 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:12.579520 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wpdsk" podStartSLOduration=3.095673252 podStartE2EDuration="21.579504418s" totalImagesPullingTime="18.483831166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.579395225 +0000 UTC m=+22.683546317" watchObservedRunningTime="2026-07-02 19:55:12.579504418 +0000 UTC m=+22.683655513" Jul 02 19:55:13.392202 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.392182 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:13.392487 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:13.392292 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:13.410445 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.410412 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 02 19:55:13.494373 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.494340 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8jwc4" event={"ID":"e4775105-1f50-4ffe-8d19-068fa4e85e99","Type":"ContainerStarted","Data":"ee17846e30bd8892c0147ce301ef684f212f45e0ba625278a1df478b45dc1632"} Jul 02 19:55:13.496055 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.496025 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" event={"ID":"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4","Type":"ContainerStarted","Data":"4053667d8ffafe98fba3c58268dd29e4ac4c1a684879534ba00e2d37505b3343"} Jul 02 19:55:13.511128 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.511084 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-139-102.ec2.internal" podStartSLOduration=21.51107155 podStartE2EDuration="21.51107155s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:12.602171346 +0000 UTC m=+22.706322442" watchObservedRunningTime="2026-07-02 19:55:13.51107155 +0000 UTC m=+23.615222642" Jul 02 19:55:13.511420 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:13.511391 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8jwc4" podStartSLOduration=4.954963967 podStartE2EDuration="23.511384299s" totalImagesPullingTime="18.556420332s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:13.510646141 +0000 UTC m=+23.614797237" watchObservedRunningTime="2026-07-02 19:55:13.511384299 +0000 UTC m=+23.615535426" Jul 02 19:55:14.352328 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.352221 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-02T19:55:13.410443756Z","UUID":"fb433956-e7ae-434a-8323-70f72950c504","Handler":null,"Name":"","Endpoint":""} Jul 02 19:55:14.353722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.353705 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 02 19:55:14.353822 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.353743 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 02 19:55:14.391729 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.391697 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:14.391910 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:14.391818 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:14.392234 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.392210 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:14.392610 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:14.392313 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:14.502667 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:14.502443 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"53e997ebb45a1d8ff621d8bdf88aae4cc5a27fe25f5ded2ddf4f2b2a94e8ecae"} Jul 02 19:55:15.391752 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:15.391720 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:15.391921 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:15.391812 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:15.507417 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:15.507376 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" event={"ID":"c60d4f4b-62a2-4b56-ab88-b41c3eed3af4","Type":"ContainerStarted","Data":"f76f8021cc882db9a226d97b865f7bac0bc30e0d1786fae18eb689a45494ee4f"} Jul 02 19:55:15.526161 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:15.526113 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-m9n54" podStartSLOduration=3.886825874 podStartE2EDuration="25.526100901s" totalImagesPullingTime="21.639275027s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:15.526029841 +0000 UTC m=+25.630180933" watchObservedRunningTime="2026-07-02 19:55:15.526100901 +0000 UTC m=+25.630251993" Jul 02 19:55:15.800910 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:15.800833 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:55:15.801388 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:15.801371 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:55:16.391498 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:16.391465 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:16.391661 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:16.391575 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:16.391661 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:16.391622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:16.391732 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:16.391713 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:16.514719 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:16.514670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" event={"ID":"24d84617-286b-40c0-a763-ea79436791e6","Type":"ContainerStarted","Data":"3b7f2dccdc8b6af37337cb017dd4d78681717a0a3196464c119e6ae09dc2b898"} Jul 02 19:55:17.392339 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.392162 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:17.392535 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:17.392429 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:17.517687 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.517384 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:17.517687 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.517573 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:17.517687 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.517644 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:17.534940 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.534901 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:17.535372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.535357 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:17.544430 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:17.544384 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" podStartSLOduration=7.499968071 podStartE2EDuration="26.544367867s" totalImagesPullingTime="19.044399796s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:17.543507104 +0000 UTC m=+27.647658196" watchObservedRunningTime="2026-07-02 19:55:17.544367867 +0000 UTC m=+27.648518960" Jul 02 19:55:18.079108 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.079078 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:55:18.079294 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.079233 2568 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 02 19:55:18.079831 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.079805 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mlvml" Jul 02 19:55:18.392235 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.392145 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:18.392235 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.392181 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:18.392451 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:18.392286 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:18.392451 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:18.392404 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:18.472508 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.472473 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tnhmx"] Jul 02 19:55:18.477457 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.477427 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtr5g"] Jul 02 19:55:18.478164 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.478142 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7p8d4"] Jul 02 19:55:18.478277 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.478237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:18.478404 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:18.478344 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:18.519209 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.519163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:18.519806 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:18.519288 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:18.520111 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:18.520091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:18.520240 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:18.520212 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:19.522713 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:19.522627 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="bd1b15f5a5a637af2cd1d40d92311acf2029395eb93e0a62585e130fd49f4c73" exitCode=0 Jul 02 19:55:19.522713 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:19.522702 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"bd1b15f5a5a637af2cd1d40d92311acf2029395eb93e0a62585e130fd49f4c73"} Jul 02 19:55:20.392281 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:20.392206 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:20.392281 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:20.392206 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:20.392281 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:20.392215 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:20.393687 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:20.393453 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:20.393812 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:20.393788 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:20.393900 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:20.393861 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:20.527112 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:20.527088 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="39ae9642a1c4f42f81f3c0930c234299227740d7feb7307f898f18128a2c73c7" exitCode=0 Jul 02 19:55:20.527384 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:20.527130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"39ae9642a1c4f42f81f3c0930c234299227740d7feb7307f898f18128a2c73c7"} Jul 02 19:55:22.392259 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:22.392076 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:22.392900 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:22.392087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:22.392900 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:22.392347 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-mtr5g" podUID="89e4dece-a742-4f11-bbe8-9d7e1452dce1" Jul 02 19:55:22.392900 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:22.392087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:22.392900 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:22.392413 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tnhmx" podUID="3ab9d5ec-c35c-404d-9dfa-d841531665b5" Jul 02 19:55:22.392900 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:22.392513 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7p8d4" podUID="33862b5d-5eb7-44b6-936b-fb288c0368c2" Jul 02 19:55:22.535636 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:22.535603 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="e27751bfe369f68817ccca7a78476d1927916a8145d7ae3cba6832ac38d69102" exitCode=0 Jul 02 19:55:22.535773 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:22.535645 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"e27751bfe369f68817ccca7a78476d1927916a8145d7ae3cba6832ac38d69102"} Jul 02 19:55:24.063928 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.063894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:24.064438 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.064038 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 02 19:55:24.064438 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.064062 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 02 19:55:24.064438 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.064076 2568 projected.go:196] Error preparing data for projected volume kube-api-access-f7zpn for pod openshift-network-diagnostics/network-check-target-mtr5g: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:55:24.064438 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.064143 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn podName:89e4dece-a742-4f11-bbe8-9d7e1452dce1 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.064123254 +0000 UTC m=+66.168274348 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-f7zpn" (UniqueName: "kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn") pod "network-check-target-mtr5g" (UID: "89e4dece-a742-4f11-bbe8-9d7e1452dce1") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 02 19:55:24.165130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.165085 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:24.165130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.165136 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:24.165322 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.165241 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:24.165322 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.165306 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret podName:33862b5d-5eb7-44b6-936b-fb288c0368c2 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.165291634 +0000 UTC m=+66.269442704 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret") pod "global-pull-secret-syncer-7p8d4" (UID: "33862b5d-5eb7-44b6-936b-fb288c0368c2") : object "kube-system"/"original-pull-secret" not registered Jul 02 19:55:24.165392 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.165241 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:24.165392 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.165362 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs podName:3ab9d5ec-c35c-404d-9dfa-d841531665b5 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.165350913 +0000 UTC m=+66.269501988 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs") pod "network-metrics-daemon-tnhmx" (UID: "3ab9d5ec-c35c-404d-9dfa-d841531665b5") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 02 19:55:24.206763 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.206729 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-139-102.ec2.internal" event="NodeReady" Jul 02 19:55:24.207018 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.206902 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 02 19:55:24.242503 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.242471 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:55:24.246097 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.246073 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-sn759"] Jul 02 19:55:24.246231 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.246213 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.248767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.248746 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 02 19:55:24.248979 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.248957 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-85d9b775df-jr9dz"] Jul 02 19:55:24.249096 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.249067 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.252980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.251904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 02 19:55:24.255047 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.254254 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7fwl\"" Jul 02 19:55:24.255047 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.254486 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-k5d4w\"" Jul 02 19:55:24.255047 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.254664 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 02 19:55:24.255805 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.255666 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 02 19:55:24.256118 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.255895 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.256118 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.255904 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 02 19:55:24.256272 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.256218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.256533 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.256509 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd"] Jul 02 19:55:24.256966 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.256941 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.259187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.259118 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 02 19:55:24.259294 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.259219 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p"] Jul 02 19:55:24.259398 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.259349 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.259714 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.259693 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 02 19:55:24.260047 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.259935 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 02 19:55:24.260203 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.260183 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.260329 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.260315 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 02 19:55:24.260391 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.260339 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j8nsb\"" Jul 02 19:55:24.260999 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.260983 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.261491 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.261475 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 02 19:55:24.261656 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.261628 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 02 19:55:24.262650 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.262633 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-l9vwb"] Jul 02 19:55:24.262754 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.262741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.264521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.264501 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 02 19:55:24.264622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.264523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.264755 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.264735 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.264821 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.264757 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hg5vs\"" Jul 02 19:55:24.264897 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.264735 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 02 19:55:24.265131 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.265106 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q6pfd\"" Jul 02 19:55:24.265679 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.265663 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 02 19:55:24.265798 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.265683 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.265947 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.265927 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.266306 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.266263 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v"] Jul 02 19:55:24.266432 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.266411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.269201 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.269185 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sxgzh\"" Jul 02 19:55:24.269391 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.269372 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 02 19:55:24.269544 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.269316 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.269671 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.269241 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 02 19:55:24.270014 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.269999 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.270795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.270776 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg"] Jul 02 19:55:24.270966 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.270948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" Jul 02 19:55:24.281203 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.281176 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.281665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.281188 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.283710 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.283006 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-h62c5\"" Jul 02 19:55:24.287901 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287357 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 02 19:55:24.287901 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287843 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-sn759"] Jul 02 19:55:24.287901 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287889 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d9b775df-jr9dz"] Jul 02 19:55:24.288193 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287919 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd"] Jul 02 19:55:24.288193 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287939 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p"] Jul 02 19:55:24.288193 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.287987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.288376 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.288179 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-l9vwb"] Jul 02 19:55:24.288485 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.288471 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v"] Jul 02 19:55:24.289568 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.289550 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:55:24.291657 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.291635 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh"] Jul 02 19:55:24.292187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.292037 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 02 19:55:24.292187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.292094 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.292187 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.292115 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.293543 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.293523 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 02 19:55:24.293631 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.293614 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zp9dd\"" Jul 02 19:55:24.295138 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.295121 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq"] Jul 02 19:55:24.295246 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.295233 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.298142 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298125 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-bk752\"" Jul 02 19:55:24.298273 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298222 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 02 19:55:24.298471 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298422 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.298545 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298474 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5prcx"] Jul 02 19:55:24.298836 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298820 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" Jul 02 19:55:24.299004 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.298985 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.299095 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.299080 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 02 19:55:24.302025 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.302007 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mrpc4"] Jul 02 19:55:24.302809 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.302773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.303844 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.303826 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.304577 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.304427 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-p6p7b\"" Jul 02 19:55:24.304773 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.304751 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.305327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.305308 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 02 19:55:24.305327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.305324 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-4pv92\"" Jul 02 19:55:24.305590 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.305572 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 02 19:55:24.306278 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.305932 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 02 19:55:24.306849 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.306831 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg"] Jul 02 19:55:24.306977 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.306889 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq"] Jul 02 19:55:24.306977 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.306913 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrpc4"] Jul 02 19:55:24.306977 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.306934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh"] Jul 02 19:55:24.307121 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.307009 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.309158 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.309141 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 02 19:55:24.309525 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.309510 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 02 19:55:24.309762 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.309736 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vxz4\"" Jul 02 19:55:24.314518 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.314500 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5prcx"] Jul 02 19:55:24.366075 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e351b6-6ed5-4b60-b95f-8ec72d419991-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.366217 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.366289 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366249 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-snapshots\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.366289 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366277 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzj7n\" (UniqueName: \"kubernetes.io/projected/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-kube-api-access-nzj7n\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.366385 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.366385 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366328 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.366477 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2d9p\" (UniqueName: \"kubernetes.io/projected/c0e351b6-6ed5-4b60-b95f-8ec72d419991-kube-api-access-j2d9p\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.366477 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461340a3-9650-4d9d-9e84-e55eaee364be-serving-cert\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.366578 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366492 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-default-certificate\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.366578 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366520 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.366578 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e351b6-6ed5-4b60-b95f-8ec72d419991-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-serving-cert\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xrq54\" (UniqueName: \"kubernetes.io/projected/62495e0c-c93f-4616-a7fe-594cf7ab9098-kube-api-access-xrq54\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366655 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcxs9\" (UniqueName: \"kubernetes.io/projected/4208e39e-1161-459d-990d-dba9efc47935-kube-api-access-jcxs9\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.366722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h2tcg\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366767 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366801 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366825 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-trusted-ca\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-config\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fkqv2\" (UniqueName: \"kubernetes.io/projected/461340a3-9650-4d9d-9e84-e55eaee364be-kube-api-access-fkqv2\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366902 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-stats-auth\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.366980 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.367236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.366988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.367236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.367007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.367236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.367023 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.367236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.367073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-tmp\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.391484 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.391462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:24.391592 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.391462 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:24.391655 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.391587 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:24.394396 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.394376 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:55:24.394511 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.394425 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:55:24.394580 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.394382 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n4l82\"" Jul 02 19:55:24.394708 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.394687 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cftkn\"" Jul 02 19:55:24.467938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.467907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e351b6-6ed5-4b60-b95f-8ec72d419991-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.467938 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.467939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.467965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-snapshots\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.467986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d91a8-f5dc-4fe5-ace6-45829ccac144-cert\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468010 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzj7n\" (UniqueName: \"kubernetes.io/projected/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-kube-api-access-nzj7n\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468061 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.468089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468088 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7t4zs\" (UniqueName: \"kubernetes.io/projected/6151ca11-7350-4009-a497-88256c0f6c00-kube-api-access-7t4zs\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.468372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2d9p\" (UniqueName: \"kubernetes.io/projected/c0e351b6-6ed5-4b60-b95f-8ec72d419991-kube-api-access-j2d9p\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.468372 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.468243 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.968222124 +0000 UTC m=+35.072373217 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:24.468372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468283 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461340a3-9650-4d9d-9e84-e55eaee364be-serving-cert\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.468372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468313 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-default-certificate\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.468372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468342 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ht59j\" (UniqueName: \"kubernetes.io/projected/cc756d5e-1e4d-4121-9a80-c0a8552478fe-kube-api-access-ht59j\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468371 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4rp8\" (UniqueName: \"kubernetes.io/projected/1d99a682-0a3a-45f2-9809-f62cfd3a1096-kube-api-access-c4rp8\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468406 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468432 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2tnnd\" (UniqueName: \"kubernetes.io/projected/db47aacd-fc51-49c6-8879-5bc48545ac70-kube-api-access-2tnnd\") pod \"network-check-source-989f8b8dc-srvdq\" (UID: \"db47aacd-fc51-49c6-8879-5bc48545ac70\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6151ca11-7350-4009-a497-88256c0f6c00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.468511 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:24.468618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.468587 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.968571209 +0000 UTC m=+35.072722292 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468637 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468664 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-snapshots\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468673 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e351b6-6ed5-4b60-b95f-8ec72d419991-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468719 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-serving-cert\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468748 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xrq54\" (UniqueName: \"kubernetes.io/projected/62495e0c-c93f-4616-a7fe-594cf7ab9098-kube-api-access-xrq54\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcxs9\" (UniqueName: \"kubernetes.io/projected/4208e39e-1161-459d-990d-dba9efc47935-kube-api-access-jcxs9\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.468847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lqlmh\" (UniqueName: \"kubernetes.io/projected/d34d91a8-f5dc-4fe5-ace6-45829ccac144-kube-api-access-lqlmh\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468869 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h2tcg\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc756d5e-1e4d-4121-9a80-c0a8552478fe-config-volume\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.468996 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469024 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-trusted-ca\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469048 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-config\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d99a682-0a3a-45f2-9809-f62cfd3a1096-config\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469097 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fkqv2\" (UniqueName: \"kubernetes.io/projected/461340a3-9650-4d9d-9e84-e55eaee364be-kube-api-access-fkqv2\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469123 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d99a682-0a3a-45f2-9809-f62cfd3a1096-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469148 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-stats-auth\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.469205 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469212 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469294 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469322 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-tmp\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469344 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcxfx\" (UniqueName: \"kubernetes.io/projected/1cf44374-b8fb-42af-813b-1fad0a76fdef-kube-api-access-qcxfx\") pod \"volume-data-source-validator-5d456fdbcd-t4b9v\" (UID: \"1cf44374-b8fb-42af-813b-1fad0a76fdef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" Jul 02 19:55:24.469681 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc756d5e-1e4d-4121-9a80-c0a8552478fe-tmp-dir\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.469988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469954 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.470408 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.470388 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.470556 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.470533 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.470626 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.470588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.470700 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.470681 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:24.470749 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.470734 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.97071863 +0000 UTC m=+35.074869702 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.470825 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.470842 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.470910 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:24.970894537 +0000 UTC m=+35.075045633 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.471170 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/461340a3-9650-4d9d-9e84-e55eaee364be-tmp\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.471534 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/461340a3-9650-4d9d-9e84-e55eaee364be-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.471579 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-trusted-ca\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.471940 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-config\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.472067 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.469172 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c0e351b6-6ed5-4b60-b95f-8ec72d419991-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.473276 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473184 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/461340a3-9650-4d9d-9e84-e55eaee364be-serving-cert\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.473276 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473210 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c0e351b6-6ed5-4b60-b95f-8ec72d419991-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.473437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473356 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-serving-cert\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.473437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473414 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.473550 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473532 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-default-certificate\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.473717 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473701 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.473972 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.473954 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-stats-auth\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.476920 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.476850 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j2d9p\" (UniqueName: \"kubernetes.io/projected/c0e351b6-6ed5-4b60-b95f-8ec72d419991-kube-api-access-j2d9p\") pod \"kube-storage-version-migrator-operator-846bf668f7-7q4nd\" (UID: \"c0e351b6-6ed5-4b60-b95f-8ec72d419991\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.477310 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.477285 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzj7n\" (UniqueName: \"kubernetes.io/projected/f3ca97ef-52b6-4db5-88e6-86162eefbb9a-kube-api-access-nzj7n\") pod \"console-operator-68b757fb67-l9vwb\" (UID: \"f3ca97ef-52b6-4db5-88e6-86162eefbb9a\") " pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.477838 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.477818 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcxs9\" (UniqueName: \"kubernetes.io/projected/4208e39e-1161-459d-990d-dba9efc47935-kube-api-access-jcxs9\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.478267 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.478243 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xrq54\" (UniqueName: \"kubernetes.io/projected/62495e0c-c93f-4616-a7fe-594cf7ab9098-kube-api-access-xrq54\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.478775 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.478754 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.479478 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.479447 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fkqv2\" (UniqueName: \"kubernetes.io/projected/461340a3-9650-4d9d-9e84-e55eaee364be-kube-api-access-fkqv2\") pod \"insights-operator-5c847dcfc4-sn759\" (UID: \"461340a3-9650-4d9d-9e84-e55eaee364be\") " pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.479584 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.479564 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h2tcg\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.570322 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d99a682-0a3a-45f2-9809-f62cfd3a1096-config\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.570322 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570295 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d99a682-0a3a-45f2-9809-f62cfd3a1096-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.570474 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.570474 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcxfx\" (UniqueName: \"kubernetes.io/projected/1cf44374-b8fb-42af-813b-1fad0a76fdef-kube-api-access-qcxfx\") pod \"volume-data-source-validator-5d456fdbcd-t4b9v\" (UID: \"1cf44374-b8fb-42af-813b-1fad0a76fdef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" Jul 02 19:55:24.570474 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc756d5e-1e4d-4121-9a80-c0a8552478fe-tmp-dir\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.570615 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.570542 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:24.570615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d91a8-f5dc-4fe5-ace6-45829ccac144-cert\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.570615 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.570604 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.070585721 +0000 UTC m=+35.174736795 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:24.570767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570654 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7t4zs\" (UniqueName: \"kubernetes.io/projected/6151ca11-7350-4009-a497-88256c0f6c00-kube-api-access-7t4zs\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.570767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570689 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ht59j\" (UniqueName: \"kubernetes.io/projected/cc756d5e-1e4d-4121-9a80-c0a8552478fe-kube-api-access-ht59j\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.570767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570715 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4rp8\" (UniqueName: \"kubernetes.io/projected/1d99a682-0a3a-45f2-9809-f62cfd3a1096-kube-api-access-c4rp8\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.570767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2tnnd\" (UniqueName: \"kubernetes.io/projected/db47aacd-fc51-49c6-8879-5bc48545ac70-kube-api-access-2tnnd\") pod \"network-check-source-989f8b8dc-srvdq\" (UID: \"db47aacd-fc51-49c6-8879-5bc48545ac70\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" Jul 02 19:55:24.570988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570782 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6151ca11-7350-4009-a497-88256c0f6c00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.570988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lqlmh\" (UniqueName: \"kubernetes.io/projected/d34d91a8-f5dc-4fe5-ace6-45829ccac144-kube-api-access-lqlmh\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.570988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570894 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.570988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570900 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/1d99a682-0a3a-45f2-9809-f62cfd3a1096-config\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.570988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.570928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc756d5e-1e4d-4121-9a80-c0a8552478fe-config-volume\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.571229 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.571056 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cc756d5e-1e4d-4121-9a80-c0a8552478fe-tmp-dir\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.571490 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.571406 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:24.571490 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.571463 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cc756d5e-1e4d-4121-9a80-c0a8552478fe-config-volume\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.571490 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.571470 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.071453693 +0000 UTC m=+35.175604779 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:24.572023 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.571999 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/6151ca11-7350-4009-a497-88256c0f6c00-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.572594 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.572574 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" Jul 02 19:55:24.573659 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.573620 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/1d99a682-0a3a-45f2-9809-f62cfd3a1096-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.573659 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.573636 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d34d91a8-f5dc-4fe5-ace6-45829ccac144-cert\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.579926 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.579902 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcxfx\" (UniqueName: \"kubernetes.io/projected/1cf44374-b8fb-42af-813b-1fad0a76fdef-kube-api-access-qcxfx\") pod \"volume-data-source-validator-5d456fdbcd-t4b9v\" (UID: \"1cf44374-b8fb-42af-813b-1fad0a76fdef\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" Jul 02 19:55:24.580858 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.580818 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7t4zs\" (UniqueName: \"kubernetes.io/projected/6151ca11-7350-4009-a497-88256c0f6c00-kube-api-access-7t4zs\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:24.581584 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.581368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4rp8\" (UniqueName: \"kubernetes.io/projected/1d99a682-0a3a-45f2-9809-f62cfd3a1096-kube-api-access-c4rp8\") pod \"service-ca-operator-5d46d9ffd4-hfcgh\" (UID: \"1d99a682-0a3a-45f2-9809-f62cfd3a1096\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.581584 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.581549 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2tnnd\" (UniqueName: \"kubernetes.io/projected/db47aacd-fc51-49c6-8879-5bc48545ac70-kube-api-access-2tnnd\") pod \"network-check-source-989f8b8dc-srvdq\" (UID: \"db47aacd-fc51-49c6-8879-5bc48545ac70\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" Jul 02 19:55:24.582349 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.582319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ht59j\" (UniqueName: \"kubernetes.io/projected/cc756d5e-1e4d-4121-9a80-c0a8552478fe-kube-api-access-ht59j\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:24.583215 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.583195 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lqlmh\" (UniqueName: \"kubernetes.io/projected/d34d91a8-f5dc-4fe5-ace6-45829ccac144-kube-api-access-lqlmh\") pod \"ingress-canary-5prcx\" (UID: \"d34d91a8-f5dc-4fe5-ace6-45829ccac144\") " pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.592947 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.592929 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" Jul 02 19:55:24.610571 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.610518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:24.617988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.617965 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" Jul 02 19:55:24.631177 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.631094 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" Jul 02 19:55:24.638736 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.638484 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" Jul 02 19:55:24.644472 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.644091 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5prcx" Jul 02 19:55:24.794491 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.794383 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-sn759"] Jul 02 19:55:24.831254 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.824371 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd"] Jul 02 19:55:24.832765 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:24.832703 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0e351b6_6ed5_4b60_b95f_8ec72d419991.slice/crio-87ceab29feba3e97e8ad48ec9393fc33688df25523b8e2882789591d48051b89 WatchSource:0}: Error finding container 87ceab29feba3e97e8ad48ec9393fc33688df25523b8e2882789591d48051b89: Status 404 returned error can't find the container with id 87ceab29feba3e97e8ad48ec9393fc33688df25523b8e2882789591d48051b89 Jul 02 19:55:24.873185 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.873098 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-l9vwb"] Jul 02 19:55:24.877011 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:24.876977 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3ca97ef_52b6_4db5_88e6_86162eefbb9a.slice/crio-cc87a906aec23c60853272e77696a4fe5d874bdc2bb0e764c0315fb0d2d09f50 WatchSource:0}: Error finding container cc87a906aec23c60853272e77696a4fe5d874bdc2bb0e764c0315fb0d2d09f50: Status 404 returned error can't find the container with id cc87a906aec23c60853272e77696a4fe5d874bdc2bb0e764c0315fb0d2d09f50 Jul 02 19:55:24.890933 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.890911 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v"] Jul 02 19:55:24.900586 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:24.900559 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1cf44374_b8fb_42af_813b_1fad0a76fdef.slice/crio-67034ab3136621de6128e7cda7138e060d4c89ac0a36c52c6a888d38d19d4921 WatchSource:0}: Error finding container 67034ab3136621de6128e7cda7138e060d4c89ac0a36c52c6a888d38d19d4921: Status 404 returned error can't find the container with id 67034ab3136621de6128e7cda7138e060d4c89ac0a36c52c6a888d38d19d4921 Jul 02 19:55:24.907855 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.907792 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh"] Jul 02 19:55:24.911850 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:24.911815 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d99a682_0a3a_45f2_9809_f62cfd3a1096.slice/crio-9eb2a84940b8666156484450cc56bd513078ac3629177aa980fca1e6dcecd587 WatchSource:0}: Error finding container 9eb2a84940b8666156484450cc56bd513078ac3629177aa980fca1e6dcecd587: Status 404 returned error can't find the container with id 9eb2a84940b8666156484450cc56bd513078ac3629177aa980fca1e6dcecd587 Jul 02 19:55:24.923380 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.923307 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq"] Jul 02 19:55:24.926958 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:24.926931 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb47aacd_fc51_49c6_8879_5bc48545ac70.slice/crio-df676db0db25ada3fa4f88b6687c38d5285405bdf032c9961cd33d465d943270 WatchSource:0}: Error finding container df676db0db25ada3fa4f88b6687c38d5285405bdf032c9961cd33d465d943270: Status 404 returned error can't find the container with id df676db0db25ada3fa4f88b6687c38d5285405bdf032c9961cd33d465d943270 Jul 02 19:55:24.975953 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.975921 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.976099 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.975982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:24.976099 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.976051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:24.976195 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976136 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.976116172 +0000 UTC m=+36.080267247 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:24.976253 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976189 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:24.976253 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976197 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:24.976355 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:24.976246 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:24.976355 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976312 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.976298862 +0000 UTC m=+36.080449935 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:24.976355 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976316 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:24.976355 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976327 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.976320779 +0000 UTC m=+36.080471850 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:24.976355 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976333 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:24.976593 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:24.976389 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:25.976370286 +0000 UTC m=+36.080521376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:25.076847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.076797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:25.077728 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.076977 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:25.077728 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.077003 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:25.077728 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.077091 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:26.077070163 +0000 UTC m=+36.181221233 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:25.077728 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.077109 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:25.077728 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.077189 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:26.077173747 +0000 UTC m=+36.181324857 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:25.169074 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.169046 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5prcx"] Jul 02 19:55:25.172006 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:25.171978 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd34d91a8_f5dc_4fe5_ace6_45829ccac144.slice/crio-b1ebd4ced17ccfc140bf156cee499405cf4aa3e9f78c58bab490392169cca397 WatchSource:0}: Error finding container b1ebd4ced17ccfc140bf156cee499405cf4aa3e9f78c58bab490392169cca397: Status 404 returned error can't find the container with id b1ebd4ced17ccfc140bf156cee499405cf4aa3e9f78c58bab490392169cca397 Jul 02 19:55:25.543912 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.543818 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" event={"ID":"db47aacd-fc51-49c6-8879-5bc48545ac70","Type":"ContainerStarted","Data":"df676db0db25ada3fa4f88b6687c38d5285405bdf032c9961cd33d465d943270"} Jul 02 19:55:25.545111 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.545084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" event={"ID":"1cf44374-b8fb-42af-813b-1fad0a76fdef","Type":"ContainerStarted","Data":"67034ab3136621de6128e7cda7138e060d4c89ac0a36c52c6a888d38d19d4921"} Jul 02 19:55:25.546336 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.546308 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" event={"ID":"c0e351b6-6ed5-4b60-b95f-8ec72d419991","Type":"ContainerStarted","Data":"87ceab29feba3e97e8ad48ec9393fc33688df25523b8e2882789591d48051b89"} Jul 02 19:55:25.547518 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.547490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5prcx" event={"ID":"d34d91a8-f5dc-4fe5-ace6-45829ccac144","Type":"ContainerStarted","Data":"b1ebd4ced17ccfc140bf156cee499405cf4aa3e9f78c58bab490392169cca397"} Jul 02 19:55:25.548641 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.548620 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" event={"ID":"461340a3-9650-4d9d-9e84-e55eaee364be","Type":"ContainerStarted","Data":"a19efb75b223e4924f7e230432c7bdc8d1e80e6b537d94cd76517641ee32a41b"} Jul 02 19:55:25.549844 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.549822 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" event={"ID":"1d99a682-0a3a-45f2-9809-f62cfd3a1096","Type":"ContainerStarted","Data":"9eb2a84940b8666156484450cc56bd513078ac3629177aa980fca1e6dcecd587"} Jul 02 19:55:25.550869 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.550850 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerStarted","Data":"cc87a906aec23c60853272e77696a4fe5d874bdc2bb0e764c0315fb0d2d09f50"} Jul 02 19:55:25.984623 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.984583 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:25.984795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.984681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:25.984795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.984721 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:25.984795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:25.984792 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:25.985023 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985002 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:25.985105 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985093 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:27.985074139 +0000 UTC m=+38.089225213 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:25.985557 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985535 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:25.985557 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985559 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:25.985691 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985606 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:27.985589832 +0000 UTC m=+38.089740904 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:25.985751 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985698 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:27.985685747 +0000 UTC m=+38.089836821 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:25.985818 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985759 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:25.985818 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:25.985793 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:27.985783268 +0000 UTC m=+38.089934341 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:26.085998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:26.086078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:26.086288 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:26.086353 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:28.08633399 +0000 UTC m=+38.190485065 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:26.086749 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:26.086828 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:26.086800 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:28.086783382 +0000 UTC m=+38.190934460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:28.006107 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.006066 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.006157 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006231 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006275 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006332 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.006312873 +0000 UTC m=+42.110463956 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.006197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006355 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.006345342 +0000 UTC m=+42.110496413 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.006431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006438 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006480 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.006468133 +0000 UTC m=+42.110619224 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006525 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:28.006573 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.006563 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.006551745 +0000 UTC m=+42.110702815 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:28.107236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.107196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:28.107402 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:28.107281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:28.107618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.107510 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:28.107618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.107531 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:28.107618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.107585 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.107565878 +0000 UTC m=+42.211716964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:28.107618 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:28.107604 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.107595358 +0000 UTC m=+42.211746429 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:29.063476 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.063444 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm"] Jul 02 19:55:29.080058 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.080033 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm"] Jul 02 19:55:29.080211 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.080144 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.082649 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.082617 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 02 19:55:29.083023 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.082998 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j566j\"" Jul 02 19:55:29.083203 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.083175 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 02 19:55:29.117551 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.117523 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52a8bafe-c199-4538-82c2-723d0f335b13-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.117655 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.117558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.218283 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.218260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52a8bafe-c199-4538-82c2-723d0f335b13-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.218397 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.218293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.218448 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:29.218403 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:29.218483 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:29.218450 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:29.718437173 +0000 UTC m=+39.822588244 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:29.219005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.218988 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/52a8bafe-c199-4538-82c2-723d0f335b13-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.723025 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:29.722989 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:29.723178 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:29.723143 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:29.723219 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:29.723206 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:30.723191032 +0000 UTC m=+40.827342109 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:30.731327 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:30.731294 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:30.731749 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:30.731479 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:30.731749 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:30.731562 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:32.731541483 +0000 UTC m=+42.835692558 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:32.043342 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.043310 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.043393 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.043421 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.043470 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043480 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043505 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043575 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.04355501 +0000 UTC m=+50.147706100 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043594 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043594 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.04358502 +0000 UTC m=+50.147736095 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043594 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043645 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.043629749 +0000 UTC m=+50.147780824 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:32.043791 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.043707 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.043690095 +0000 UTC m=+50.147841172 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:32.144132 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.144100 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:32.144302 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.144154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:32.144302 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.144269 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:32.144401 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.144316 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.14430361 +0000 UTC m=+50.248454681 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:32.144401 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.144367 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:32.144493 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.144420 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:40.144406014 +0000 UTC m=+50.248557099 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:32.749277 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:32.749235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:32.749420 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.749386 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:32.749491 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:32.749463 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:36.749441445 +0000 UTC m=+46.853592519 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:34.584611 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.583962 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" event={"ID":"db47aacd-fc51-49c6-8879-5bc48545ac70","Type":"ContainerStarted","Data":"7649147b35d63471424a7e177945f22b082a23113fb1c3ff7264b566ca5e8ad8"} Jul 02 19:55:34.586851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.586823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" event={"ID":"1cf44374-b8fb-42af-813b-1fad0a76fdef","Type":"ContainerStarted","Data":"2f7d084c42a47d2751d0ea76b8a9cbb30eca4d3add8b764ad73bbae0894fe78a"} Jul 02 19:55:34.588732 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.588685 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" event={"ID":"c0e351b6-6ed5-4b60-b95f-8ec72d419991","Type":"ContainerStarted","Data":"0dbeb290938f52edcc1654ffa22a643dd96730c61d9d2d7ab6e869dbc6c65053"} Jul 02 19:55:34.590533 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.590483 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5prcx" event={"ID":"d34d91a8-f5dc-4fe5-ace6-45829ccac144","Type":"ContainerStarted","Data":"e56dc477f57f63cea6839bfcf7598a8c073e6b1583b5214c398d8f613e6137cc"} Jul 02 19:55:34.592289 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.592258 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" event={"ID":"461340a3-9650-4d9d-9e84-e55eaee364be","Type":"ContainerStarted","Data":"662beeca9fe5d1a1c4b779d8b811f548548f91158009620eba2c4c7743d2f64f"} Jul 02 19:55:34.593643 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.593621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" event={"ID":"1d99a682-0a3a-45f2-9809-f62cfd3a1096","Type":"ContainerStarted","Data":"ce87976865e90178082eb398103f723ffd0b5ef587f29089d096582c4443b039"} Jul 02 19:55:34.595698 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.595645 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/0.log" Jul 02 19:55:34.595698 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.595680 2568 generic.go:356] "Generic (PLEG): container finished" podID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" containerID="f33cc553ff36fb400e2f893040361b33c30601d7916595268288f1c70cafca37" exitCode=255 Jul 02 19:55:34.595836 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.595707 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerDied","Data":"f33cc553ff36fb400e2f893040361b33c30601d7916595268288f1c70cafca37"} Jul 02 19:55:34.596001 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.595977 2568 scope.go:117] "RemoveContainer" containerID="f33cc553ff36fb400e2f893040361b33c30601d7916595268288f1c70cafca37" Jul 02 19:55:34.601751 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.601276 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-srvdq" podStartSLOduration=21.225099518 podStartE2EDuration="30.60125083s" totalImagesPullingTime="9.376151312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.600278706 +0000 UTC m=+44.704429801" watchObservedRunningTime="2026-07-02 19:55:34.60125083 +0000 UTC m=+44.705401913" Jul 02 19:55:34.610694 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.610652 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:34.610795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.610744 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:34.619596 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.618625 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" podStartSLOduration=21.221656752 podStartE2EDuration="30.618606135s" totalImagesPullingTime="9.396949383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.618278174 +0000 UTC m=+44.722429268" watchObservedRunningTime="2026-07-02 19:55:34.618606135 +0000 UTC m=+44.722757225" Jul 02 19:55:34.653430 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.653365 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" podStartSLOduration=21.185013573 podStartE2EDuration="30.653343856s" totalImagesPullingTime="9.468330283s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.650516014 +0000 UTC m=+44.754667108" watchObservedRunningTime="2026-07-02 19:55:34.653343856 +0000 UTC m=+44.757494952" Jul 02 19:55:34.702097 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.702047 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-t4b9v" podStartSLOduration=21.301849756 podStartE2EDuration="30.702025066s" totalImagesPullingTime="9.40017531s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.697844775 +0000 UTC m=+44.801995947" watchObservedRunningTime="2026-07-02 19:55:34.702025066 +0000 UTC m=+44.806176160" Jul 02 19:55:34.718397 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:34.717025 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5prcx" podStartSLOduration=1.585617933 podStartE2EDuration="10.717006105s" totalImagesPullingTime="9.131388172s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.716017402 +0000 UTC m=+44.820168496" watchObservedRunningTime="2026-07-02 19:55:34.717006105 +0000 UTC m=+44.821157199" Jul 02 19:55:35.604627 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.604552 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/1.log" Jul 02 19:55:35.605316 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.605296 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/0.log" Jul 02 19:55:35.605395 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.605339 2568 generic.go:356] "Generic (PLEG): container finished" podID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" exitCode=255 Jul 02 19:55:35.605461 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.605436 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerDied","Data":"04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b"} Jul 02 19:55:35.605556 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.605542 2568 scope.go:117] "RemoveContainer" containerID="f33cc553ff36fb400e2f893040361b33c30601d7916595268288f1c70cafca37" Jul 02 19:55:35.605844 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.605831 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:35.606074 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:35.606043 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:55:35.609342 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.609322 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="2aa4d29a8f2e5c49f689db8e04a178e4836623e9bb02031b938f8bd8f4c8e940" exitCode=0 Jul 02 19:55:35.609983 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.609964 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"2aa4d29a8f2e5c49f689db8e04a178e4836623e9bb02031b938f8bd8f4c8e940"} Jul 02 19:55:35.624013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:35.623633 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" podStartSLOduration=23.133426083 podStartE2EDuration="32.623616024s" totalImagesPullingTime="9.490189941s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:34.742640646 +0000 UTC m=+44.846791732" watchObservedRunningTime="2026-07-02 19:55:35.623616024 +0000 UTC m=+45.727767118" Jul 02 19:55:36.075677 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.075631 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-jz4hc"] Jul 02 19:55:36.097005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.096981 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.098927 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.098897 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jz4hc"] Jul 02 19:55:36.100071 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.100049 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 02 19:55:36.100847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.100625 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 02 19:55:36.100981 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.100869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d7xwp\"" Jul 02 19:55:36.184628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.184598 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/787455b8-80f7-4201-9dda-e3a2f5e78096-crio-socket\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.184743 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.184637 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/787455b8-80f7-4201-9dda-e3a2f5e78096-data-volume\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.184743 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.184722 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t262l\" (UniqueName: \"kubernetes.io/projected/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-api-access-t262l\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.184830 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.184790 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.184830 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.184812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286069 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286041 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286213 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286213 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286162 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/787455b8-80f7-4201-9dda-e3a2f5e78096-crio-socket\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286213 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286191 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/787455b8-80f7-4201-9dda-e3a2f5e78096-data-volume\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286335 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t262l\" (UniqueName: \"kubernetes.io/projected/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-api-access-t262l\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286335 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.286193 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:55:36.286408 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.286354 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:36.786337225 +0000 UTC m=+46.890488300 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : secret "insights-runtime-extractor-tls" not found Jul 02 19:55:36.286408 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286361 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/787455b8-80f7-4201-9dda-e3a2f5e78096-crio-socket\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.286408 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.286252 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:55:36.286522 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.286442 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:36.786423381 +0000 UTC m=+46.890574453 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : configmap "kube-rbac-proxy" not found Jul 02 19:55:36.286522 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.286507 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/787455b8-80f7-4201-9dda-e3a2f5e78096-data-volume\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.297040 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.297018 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t262l\" (UniqueName: \"kubernetes.io/projected/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-api-access-t262l\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.614942 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.614918 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/1.log" Jul 02 19:55:36.615374 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.615236 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:36.615432 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.615414 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:55:36.618028 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.618005 2568 generic.go:356] "Generic (PLEG): container finished" podID="3a939587-2493-4373-a746-f3aa3311ffb0" containerID="d1d3f134280b344cd7978eb65877687ad9dba5d7c3cb9759611261dd041cd187" exitCode=0 Jul 02 19:55:36.618134 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.618040 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerDied","Data":"d1d3f134280b344cd7978eb65877687ad9dba5d7c3cb9759611261dd041cd187"} Jul 02 19:55:36.790855 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.790824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:36.790966 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.790869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.790966 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:36.790905 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:36.791046 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.790977 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:36.791046 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.790993 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:55:36.791046 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.791013 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:55:36.791130 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.791048 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:44.791028717 +0000 UTC m=+54.895179803 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:36.791130 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.791064 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:37.791057649 +0000 UTC m=+47.895208721 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : secret "insights-runtime-extractor-tls" not found Jul 02 19:55:36.791130 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:36.791076 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:37.791070571 +0000 UTC m=+47.895221641 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : configmap "kube-rbac-proxy" not found Jul 02 19:55:37.478166 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:37.478141 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hgnj_c467b03d-d81a-462c-86fa-4fa553d71630/dns-node-resolver/0.log" Jul 02 19:55:37.624330 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:37.624298 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-clgx2" event={"ID":"3a939587-2493-4373-a746-f3aa3311ffb0","Type":"ContainerStarted","Data":"c068a99f37710b5fe661eaf3e55ab97d9ad9ab17317a9dc1f7dbfb712abd8550"} Jul 02 19:55:37.648744 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:37.648694 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-clgx2" podStartSLOduration=7.707934074 podStartE2EDuration="46.648676684s" totalImagesPullingTime="38.94074261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:37.647279203 +0000 UTC m=+47.751430296" watchObservedRunningTime="2026-07-02 19:55:37.648676684 +0000 UTC m=+47.752827779" Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:37.799143 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:37.799215 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:37.799364 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:37.799434 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:39.799414252 +0000 UTC m=+49.903565340 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : configmap "kube-rbac-proxy" not found Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:37.799907 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:55:37.802117 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:37.799970 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:39.799953652 +0000 UTC m=+49.904104738 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : secret "insights-runtime-extractor-tls" not found Jul 02 19:55:38.878613 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:38.878586 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpdsk_77202c31-ab05-48c8-a4d9-4903873af2b7/node-ca/0.log" Jul 02 19:55:39.281436 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:39.281368 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5prcx_d34d91a8-f5dc-4fe5-ace6-45829ccac144/serve-healthcheck-canary/0.log" Jul 02 19:55:39.815526 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:39.815486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:39.815526 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:39.815527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:39.815736 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:39.815645 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:55:39.815736 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:39.815703 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:43.81569004 +0000 UTC m=+53.919841114 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : secret "insights-runtime-extractor-tls" not found Jul 02 19:55:39.815736 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:39.815644 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 02 19:55:39.815835 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:39.815744 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:43.815735411 +0000 UTC m=+53.919886496 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : configmap "kube-rbac-proxy" not found Jul 02 19:55:40.118701 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.118675 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.118827 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.118846 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-5d8784f8cb-cdgpc: secret "image-registry-tls" not found Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.118835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.118916 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls podName:b7af0dc6-5f05-41e3-b40a-f2dce0f8b620 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.118900174 +0000 UTC m=+66.223051268 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls") pod "image-registry-5d8784f8cb-cdgpc" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620") : secret "image-registry-tls" not found Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.118956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.118962 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.118950901 +0000 UTC m=+66.223101971 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : configmap references non-existent config key: service-ca.crt Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.119019 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.119046 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls podName:4208e39e-1161-459d-990d-dba9efc47935 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.119039246 +0000 UTC m=+66.223190316 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls") pod "cluster-samples-operator-56fcf86bf-lhd2p" (UID: "4208e39e-1161-459d-990d-dba9efc47935") : secret "samples-operator-tls" not found Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.119023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:40.119090 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.119064 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 02 19:55:40.119407 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.119120 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs podName:62495e0c-c93f-4616-a7fe-594cf7ab9098 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.119114713 +0000 UTC m=+66.223265783 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs") pod "router-default-85d9b775df-jr9dz" (UID: "62495e0c-c93f-4616-a7fe-594cf7ab9098") : secret "router-metrics-certs-default" not found Jul 02 19:55:40.219745 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.219714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:40.219964 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:40.219764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:40.219964 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.219854 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:40.219964 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.219890 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 02 19:55:40.219964 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.219949 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls podName:cc756d5e-1e4d-4121-9a80-c0a8552478fe nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.219933402 +0000 UTC m=+66.324084477 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls") pod "dns-default-mrpc4" (UID: "cc756d5e-1e4d-4121-9a80-c0a8552478fe") : secret "dns-default-metrics-tls" not found Jul 02 19:55:40.220107 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:40.219973 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls podName:6151ca11-7350-4009-a497-88256c0f6c00 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:56.219966173 +0000 UTC m=+66.324117244 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-n8lpg" (UID: "6151ca11-7350-4009-a497-88256c0f6c00") : secret "cluster-monitoring-operator-tls" not found Jul 02 19:55:43.853401 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:43.853362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:43.853401 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:43.853400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:43.853906 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:43.853515 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 02 19:55:43.853906 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:43.853582 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls podName:787455b8-80f7-4201-9dda-e3a2f5e78096 nodeName:}" failed. No retries permitted until 2026-07-02 19:55:51.85356734 +0000 UTC m=+61.957718411 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls") pod "insights-runtime-extractor-jz4hc" (UID: "787455b8-80f7-4201-9dda-e3a2f5e78096") : secret "insights-runtime-extractor-tls" not found Jul 02 19:55:43.853990 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:43.853907 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/787455b8-80f7-4201-9dda-e3a2f5e78096-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:44.611534 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:44.611509 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:44.611695 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:44.611596 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:44.611848 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:44.611836 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:44.612002 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:44.611984 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:55:44.646304 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:44.646280 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:44.646434 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:44.646417 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:55:44.864171 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:44.864086 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:55:44.864522 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:44.864230 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 02 19:55:44.864522 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:44.864298 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert podName:52a8bafe-c199-4538-82c2-723d0f335b13 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:00.864280306 +0000 UTC m=+70.968431377 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-bq8jm" (UID: "52a8bafe-c199-4538-82c2-723d0f335b13") : secret "networking-console-plugin-cert" not found Jul 02 19:55:49.541273 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:49.541243 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-nn5g4" Jul 02 19:55:51.923724 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:51.923693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:51.925860 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:51.925840 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/787455b8-80f7-4201-9dda-e3a2f5e78096-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-jz4hc\" (UID: \"787455b8-80f7-4201-9dda-e3a2f5e78096\") " pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:52.010542 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:52.010516 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-d7xwp\"" Jul 02 19:55:52.018843 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:52.018818 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-jz4hc" Jul 02 19:55:52.136044 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:52.136021 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-jz4hc"] Jul 02 19:55:52.137930 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:52.137907 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod787455b8_80f7_4201_9dda_e3a2f5e78096.slice/crio-c889c670b446597804d124eff33ab831a4e0e7e99835baa852413d45b445f5c0 WatchSource:0}: Error finding container c889c670b446597804d124eff33ab831a4e0e7e99835baa852413d45b445f5c0: Status 404 returned error can't find the container with id c889c670b446597804d124eff33ab831a4e0e7e99835baa852413d45b445f5c0 Jul 02 19:55:52.672575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:52.672541 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz4hc" event={"ID":"787455b8-80f7-4201-9dda-e3a2f5e78096","Type":"ContainerStarted","Data":"c889c670b446597804d124eff33ab831a4e0e7e99835baa852413d45b445f5c0"} Jul 02 19:55:56.065740 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.065713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:56.068238 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.068214 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7zpn\" (UniqueName: \"kubernetes.io/projected/89e4dece-a742-4f11-bbe8-9d7e1452dce1-kube-api-access-f7zpn\") pod \"network-check-target-mtr5g\" (UID: \"89e4dece-a742-4f11-bbe8-9d7e1452dce1\") " pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:56.166310 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166275 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:56.166458 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:56.166458 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166402 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:56.166458 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:56.166570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166473 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:56.166570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.166500 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:56.167092 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.167072 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/62495e0c-c93f-4616-a7fe-594cf7ab9098-service-ca-bundle\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:56.168817 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.168795 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"image-registry-5d8784f8cb-cdgpc\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:56.168949 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.168923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/4208e39e-1161-459d-990d-dba9efc47935-samples-operator-tls\") pod \"cluster-samples-operator-56fcf86bf-lhd2p\" (UID: \"4208e39e-1161-459d-990d-dba9efc47935\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:56.169196 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.169181 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 02 19:55:56.169248 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.169231 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 02 19:55:56.169301 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.169238 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/62495e0c-c93f-4616-a7fe-594cf7ab9098-metrics-certs\") pod \"router-default-85d9b775df-jr9dz\" (UID: \"62495e0c-c93f-4616-a7fe-594cf7ab9098\") " pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:56.178956 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.178937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3ab9d5ec-c35c-404d-9dfa-d841531665b5-metrics-certs\") pod \"network-metrics-daemon-tnhmx\" (UID: \"3ab9d5ec-c35c-404d-9dfa-d841531665b5\") " pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:56.179329 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.179311 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/33862b5d-5eb7-44b6-936b-fb288c0368c2-original-pull-secret\") pod \"global-pull-secret-syncer-7p8d4\" (UID: \"33862b5d-5eb7-44b6-936b-fb288c0368c2\") " pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:56.206529 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.206508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7p8d4" Jul 02 19:55:56.215761 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.215744 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-n4l82\"" Jul 02 19:55:56.220697 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.220680 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-cftkn\"" Jul 02 19:55:56.223490 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.223478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:56.229427 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.229411 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tnhmx" Jul 02 19:55:56.267521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.267049 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:56.267521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.267121 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:56.270257 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.270225 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/6151ca11-7350-4009-a497-88256c0f6c00-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-n8lpg\" (UID: \"6151ca11-7350-4009-a497-88256c0f6c00\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:56.271105 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.271081 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cc756d5e-1e4d-4121-9a80-c0a8552478fe-metrics-tls\") pod \"dns-default-mrpc4\" (UID: \"cc756d5e-1e4d-4121-9a80-c0a8552478fe\") " pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:56.349121 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.345849 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7p8d4"] Jul 02 19:55:56.360339 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.360314 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-mtr5g"] Jul 02 19:55:56.362914 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.362868 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e4dece_a742_4f11_bbe8_9d7e1452dce1.slice/crio-d0af4caaa9df2b5b48cc9f1e30055aa704e39a7d914e934be73f040562840bb2 WatchSource:0}: Error finding container d0af4caaa9df2b5b48cc9f1e30055aa704e39a7d914e934be73f040562840bb2: Status 404 returned error can't find the container with id d0af4caaa9df2b5b48cc9f1e30055aa704e39a7d914e934be73f040562840bb2 Jul 02 19:55:56.365120 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.365101 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-t7fwl\"" Jul 02 19:55:56.373148 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.373133 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:56.379452 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.379429 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tnhmx"] Jul 02 19:55:56.382314 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.382294 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3ab9d5ec_c35c_404d_9dfa_d841531665b5.slice/crio-aae60afc27ee483d7e8afcc7bd4872c6a96050804962b019ad1d0ef07fabe004 WatchSource:0}: Error finding container aae60afc27ee483d7e8afcc7bd4872c6a96050804962b019ad1d0ef07fabe004: Status 404 returned error can't find the container with id aae60afc27ee483d7e8afcc7bd4872c6a96050804962b019ad1d0ef07fabe004 Jul 02 19:55:56.383101 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.383081 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-j8nsb\"" Jul 02 19:55:56.391565 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.391540 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:56.402810 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.402790 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-q6pfd\"" Jul 02 19:55:56.410708 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.410686 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" Jul 02 19:55:56.434570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.434358 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-zp9dd\"" Jul 02 19:55:56.434900 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.434724 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" Jul 02 19:55:56.451903 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.451633 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5vxz4\"" Jul 02 19:55:56.459746 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.459489 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mrpc4" Jul 02 19:55:56.537483 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.532832 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:55:56.540361 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.540304 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7af0dc6_5f05_41e3_b40a_f2dce0f8b620.slice/crio-3b314597df24296874892300532f0047add723a9baf464d296aba650955a1e9c WatchSource:0}: Error finding container 3b314597df24296874892300532f0047add723a9baf464d296aba650955a1e9c: Status 404 returned error can't find the container with id 3b314597df24296874892300532f0047add723a9baf464d296aba650955a1e9c Jul 02 19:55:56.563920 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.563836 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-85d9b775df-jr9dz"] Jul 02 19:55:56.569775 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.569745 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62495e0c_c93f_4616_a7fe_594cf7ab9098.slice/crio-ed033cd86c035390fe8bca869a4c88fc9ae2a8c8e4289cf1b97d5d008193422c WatchSource:0}: Error finding container ed033cd86c035390fe8bca869a4c88fc9ae2a8c8e4289cf1b97d5d008193422c: Status 404 returned error can't find the container with id ed033cd86c035390fe8bca869a4c88fc9ae2a8c8e4289cf1b97d5d008193422c Jul 02 19:55:56.588767 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.588717 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p"] Jul 02 19:55:56.626553 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.626384 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg"] Jul 02 19:55:56.630735 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.630710 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6151ca11_7350_4009_a497_88256c0f6c00.slice/crio-12b4cae4944904ab514a2b57a52aeeb34aa3c99130f6fe54e7b6ee424eb641a7 WatchSource:0}: Error finding container 12b4cae4944904ab514a2b57a52aeeb34aa3c99130f6fe54e7b6ee424eb641a7: Status 404 returned error can't find the container with id 12b4cae4944904ab514a2b57a52aeeb34aa3c99130f6fe54e7b6ee424eb641a7 Jul 02 19:55:56.652603 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.652577 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mrpc4"] Jul 02 19:55:56.655437 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:55:56.655410 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcc756d5e_1e4d_4121_9a80_c0a8552478fe.slice/crio-fa75a57155ed0c69a49557153834aba72cea703ca2a1e1c5d7f6635d26a79aed WatchSource:0}: Error finding container fa75a57155ed0c69a49557153834aba72cea703ca2a1e1c5d7f6635d26a79aed: Status 404 returned error can't find the container with id fa75a57155ed0c69a49557153834aba72cea703ca2a1e1c5d7f6635d26a79aed Jul 02 19:55:56.686333 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.686304 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrpc4" event={"ID":"cc756d5e-1e4d-4121-9a80-c0a8552478fe","Type":"ContainerStarted","Data":"fa75a57155ed0c69a49557153834aba72cea703ca2a1e1c5d7f6635d26a79aed"} Jul 02 19:55:56.687485 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.687451 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" event={"ID":"6151ca11-7350-4009-a497-88256c0f6c00","Type":"ContainerStarted","Data":"12b4cae4944904ab514a2b57a52aeeb34aa3c99130f6fe54e7b6ee424eb641a7"} Jul 02 19:55:56.688850 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.688825 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz4hc" event={"ID":"787455b8-80f7-4201-9dda-e3a2f5e78096","Type":"ContainerStarted","Data":"db36e1fb9886011f4f5516614016fda9564317478470ac91efeac0b65b6c72c5"} Jul 02 19:55:56.690340 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.690317 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" event={"ID":"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620","Type":"ContainerStarted","Data":"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2"} Jul 02 19:55:56.690445 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.690356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" event={"ID":"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620","Type":"ContainerStarted","Data":"3b314597df24296874892300532f0047add723a9baf464d296aba650955a1e9c"} Jul 02 19:55:56.690445 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.690410 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:55:56.691451 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.691422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7p8d4" event={"ID":"33862b5d-5eb7-44b6-936b-fb288c0368c2","Type":"ContainerStarted","Data":"1d10e049f75f3c297648b7d39c2f38642b0dccaf843ebf0f0aac8eecf5d4b8d7"} Jul 02 19:55:56.692492 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.692473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" event={"ID":"4208e39e-1161-459d-990d-dba9efc47935","Type":"ContainerStarted","Data":"b0ab35a2a2e965638cdbc4eb83d4102c6aba13e1cc94b1843251278cb3ce6d65"} Jul 02 19:55:56.694134 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.694102 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d9b775df-jr9dz" event={"ID":"62495e0c-c93f-4616-a7fe-594cf7ab9098","Type":"ContainerStarted","Data":"e5e71dfc347fbee6347c6c69f79b93ce38e90ff073b1320e3780c2e968d6258f"} Jul 02 19:55:56.694235 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.694143 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-85d9b775df-jr9dz" event={"ID":"62495e0c-c93f-4616-a7fe-594cf7ab9098","Type":"ContainerStarted","Data":"ed033cd86c035390fe8bca869a4c88fc9ae2a8c8e4289cf1b97d5d008193422c"} Jul 02 19:55:56.695861 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.695807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnhmx" event={"ID":"3ab9d5ec-c35c-404d-9dfa-d841531665b5","Type":"ContainerStarted","Data":"aae60afc27ee483d7e8afcc7bd4872c6a96050804962b019ad1d0ef07fabe004"} Jul 02 19:55:56.697333 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.697311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtr5g" event={"ID":"89e4dece-a742-4f11-bbe8-9d7e1452dce1","Type":"ContainerStarted","Data":"c42cc9aaaf1091f2715095a52bec875542a16ca12254d3c0c1201855e6d771d6"} Jul 02 19:55:56.697408 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.697347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-mtr5g" event={"ID":"89e4dece-a742-4f11-bbe8-9d7e1452dce1","Type":"ContainerStarted","Data":"d0af4caaa9df2b5b48cc9f1e30055aa704e39a7d914e934be73f040562840bb2"} Jul 02 19:55:56.697475 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.697453 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:55:56.712060 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.712014 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" podStartSLOduration=65.711998087 podStartE2EDuration="1m5.711998087s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:56.711941053 +0000 UTC m=+66.816092143" watchObservedRunningTime="2026-07-02 19:55:56.711998087 +0000 UTC m=+66.816149180" Jul 02 19:55:56.734008 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.733956 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-85d9b775df-jr9dz" podStartSLOduration=53.733936892 podStartE2EDuration="53.733936892s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:56.733342899 +0000 UTC m=+66.837493994" watchObservedRunningTime="2026-07-02 19:55:56.733936892 +0000 UTC m=+66.838087986" Jul 02 19:55:56.753167 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:56.753111 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-mtr5g" podStartSLOduration=66.75309083 podStartE2EDuration="1m6.75309083s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:56.752338809 +0000 UTC m=+66.856489905" watchObservedRunningTime="2026-07-02 19:55:56.75309083 +0000 UTC m=+66.857241978" Jul 02 19:55:57.392494 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.392237 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:57.392494 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.392398 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:57.395505 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.395480 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:57.707440 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.706174 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/1.log" Jul 02 19:55:57.707440 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.706262 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerStarted","Data":"1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805"} Jul 02 19:55:57.707440 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.707227 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:55:57.708856 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.708558 2568 patch_prober.go:28] interesting pod/console-operator-68b757fb67-l9vwb container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Jul 02 19:55:57.708856 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.708606 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Jul 02 19:55:57.712652 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.711503 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz4hc" event={"ID":"787455b8-80f7-4201-9dda-e3a2f5e78096","Type":"ContainerStarted","Data":"1976f2a24a560af2392680ee504284d4822359b8768f64674803e22355424b4b"} Jul 02 19:55:57.712652 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.712615 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:57.714222 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.714178 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-85d9b775df-jr9dz" Jul 02 19:55:57.748020 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:57.746501 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podStartSLOduration=44.321429207 podStartE2EDuration="53.746479099s" totalImagesPullingTime="9.425049892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:57.725102279 +0000 UTC m=+67.829253374" watchObservedRunningTime="2026-07-02 19:55:57.746479099 +0000 UTC m=+67.850630194" Jul 02 19:55:58.718711 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.718665 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 19:55:58.719372 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.719345 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/1.log" Jul 02 19:55:58.719496 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.719387 2568 generic.go:356] "Generic (PLEG): container finished" podID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" containerID="1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805" exitCode=255 Jul 02 19:55:58.719496 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.719480 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerDied","Data":"1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805"} Jul 02 19:55:58.719608 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.719531 2568 scope.go:117] "RemoveContainer" containerID="04de60f75001f3993a20e4dabfafd020e321f02d176b3179b50ec55552ca2b0b" Jul 02 19:55:58.720089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.719970 2568 scope.go:117] "RemoveContainer" containerID="1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805" Jul 02 19:55:58.720193 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:58.720158 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:55:58.723755 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.723672 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnhmx" event={"ID":"3ab9d5ec-c35c-404d-9dfa-d841531665b5","Type":"ContainerStarted","Data":"84e91fc5372c873aaeeaf73121199480419e01273fab50c30425627830a56ee2"} Jul 02 19:55:58.723755 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.723721 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tnhmx" event={"ID":"3ab9d5ec-c35c-404d-9dfa-d841531665b5","Type":"ContainerStarted","Data":"bd7d31db708a102a966f4f5c4680c8821f8ed1b95dddd2cd5a21119241adfe9f"} Jul 02 19:55:58.756039 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:58.755689 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tnhmx" podStartSLOduration=66.114392952 podStartE2EDuration="1m7.755668702s" totalImagesPullingTime="1.64127575s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:55:58.754470865 +0000 UTC m=+68.858621958" watchObservedRunningTime="2026-07-02 19:55:58.755668702 +0000 UTC m=+68.859819777" Jul 02 19:55:59.727713 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:55:59.727682 2568 scope.go:117] "RemoveContainer" containerID="1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805" Jul 02 19:55:59.728178 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:55:59.727890 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:56:00.914779 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:00.914734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:56:00.917375 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:00.917350 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/52a8bafe-c199-4538-82c2-723d0f335b13-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-bq8jm\" (UID: \"52a8bafe-c199-4538-82c2-723d0f335b13\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:56:01.195728 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:01.195659 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-j566j\"" Jul 02 19:56:01.203978 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:01.203956 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" Jul 02 19:56:03.333472 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.333446 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm"] Jul 02 19:56:03.468518 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:56:03.468491 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52a8bafe_c199_4538_82c2_723d0f335b13.slice/crio-e2eccf3708e8e3814dd611e5c024f5c212c50193d50ee562b4bcdcb9b041bcc1 WatchSource:0}: Error finding container e2eccf3708e8e3814dd611e5c024f5c212c50193d50ee562b4bcdcb9b041bcc1: Status 404 returned error can't find the container with id e2eccf3708e8e3814dd611e5c024f5c212c50193d50ee562b4bcdcb9b041bcc1 Jul 02 19:56:03.747221 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.747181 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrpc4" event={"ID":"cc756d5e-1e4d-4121-9a80-c0a8552478fe","Type":"ContainerStarted","Data":"df03d6b2eb9d6f859fe32fcd96365ca29ec378a73c7fafcc6ffa0c73a65f2ddd"} Jul 02 19:56:03.747383 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.747248 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mrpc4" event={"ID":"cc756d5e-1e4d-4121-9a80-c0a8552478fe","Type":"ContainerStarted","Data":"d609c040d40b0228de3d96a6f469534aafe96d28612fbce2ba25a76173344a0c"} Jul 02 19:56:03.747860 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.747823 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mrpc4" Jul 02 19:56:03.749243 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.749217 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" event={"ID":"6151ca11-7350-4009-a497-88256c0f6c00","Type":"ContainerStarted","Data":"68d578b49f33d1d12bc18eaa1e546e4ee6d70bfc1787363afe91bdc61ad37080"} Jul 02 19:56:03.750565 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.750537 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" event={"ID":"52a8bafe-c199-4538-82c2-723d0f335b13","Type":"ContainerStarted","Data":"e2eccf3708e8e3814dd611e5c024f5c212c50193d50ee562b4bcdcb9b041bcc1"} Jul 02 19:56:03.752063 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.752041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 19:56:03.754418 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.754396 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-jz4hc" event={"ID":"787455b8-80f7-4201-9dda-e3a2f5e78096","Type":"ContainerStarted","Data":"c0d7d9eaec07615ac6f36b3da6f9dfe152748398d41199c3ee161ad736fa2840"} Jul 02 19:56:03.756548 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.756519 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7p8d4" event={"ID":"33862b5d-5eb7-44b6-936b-fb288c0368c2","Type":"ContainerStarted","Data":"d20cee66c3f2b2b2e00cba2fb15e13812b3ea2fd367535306f0b6ec9ddc74e79"} Jul 02 19:56:03.758992 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.758966 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" event={"ID":"4208e39e-1161-459d-990d-dba9efc47935","Type":"ContainerStarted","Data":"a678dc93948777a3f74032a9b47d69c4d77ac362b1233520ece07ed093095cdf"} Jul 02 19:56:03.759077 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.759016 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" event={"ID":"4208e39e-1161-459d-990d-dba9efc47935","Type":"ContainerStarted","Data":"afceb5239416a291ef8dd70471271e1c94606d8adf1ff6b541f304672803ae1a"} Jul 02 19:56:03.767486 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.767258 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mrpc4" podStartSLOduration=33.224873184 podStartE2EDuration="39.767241025s" totalImagesPullingTime="6.542367841s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:03.766224583 +0000 UTC m=+73.870375677" watchObservedRunningTime="2026-07-02 19:56:03.767241025 +0000 UTC m=+73.871392122" Jul 02 19:56:03.785236 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.785185 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-56fcf86bf-lhd2p" podStartSLOduration=53.254816582 podStartE2EDuration="59.785169584s" totalImagesPullingTime="6.530353002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:03.783816886 +0000 UTC m=+73.887967980" watchObservedRunningTime="2026-07-02 19:56:03.785169584 +0000 UTC m=+73.889320710" Jul 02 19:56:03.807296 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.807243 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-n8lpg" podStartSLOduration=53.238591454 podStartE2EDuration="59.807225837s" totalImagesPullingTime="6.568634383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:03.806696908 +0000 UTC m=+73.910848002" watchObservedRunningTime="2026-07-02 19:56:03.807225837 +0000 UTC m=+73.911376931" Jul 02 19:56:03.814650 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.814627 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc"] Jul 02 19:56:03.827246 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.827227 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc"] Jul 02 19:56:03.827335 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.827305 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:03.829749 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.829727 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-9wxq9\"" Jul 02 19:56:03.829853 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.829774 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\"" Jul 02 19:56:03.832040 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.831854 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-jz4hc" podStartSLOduration=16.874178015 podStartE2EDuration="27.831813116s" totalImagesPullingTime="10.957635101s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:55:36 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:03.831763119 +0000 UTC m=+73.935914215" watchObservedRunningTime="2026-07-02 19:56:03.831813116 +0000 UTC m=+73.935964212" Jul 02 19:56:03.834725 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.834703 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lrrqc\" (UID: \"f8c04424-7231-4f2f-bd82-8a0a7221fd4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:03.849506 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.849468 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7p8d4" podStartSLOduration=65.699495995 podStartE2EDuration="1m12.84945505s" totalImagesPullingTime="7.149959055s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 19:54:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:03.848954686 +0000 UTC m=+73.953105782" watchObservedRunningTime="2026-07-02 19:56:03.84945505 +0000 UTC m=+73.953606142" Jul 02 19:56:03.936402 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:03.936329 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lrrqc\" (UID: \"f8c04424-7231-4f2f-bd82-8a0a7221fd4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:03.936530 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:03.936462 2568 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found Jul 02 19:56:03.936575 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:03.936532 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates podName:f8c04424-7231-4f2f-bd82-8a0a7221fd4d nodeName:}" failed. No retries permitted until 2026-07-02 19:56:04.436516259 +0000 UTC m=+74.540667333 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates") pod "prometheus-operator-admission-webhook-d559d66d5-lrrqc" (UID: "f8c04424-7231-4f2f-bd82-8a0a7221fd4d") : secret "prometheus-operator-admission-webhook-tls" not found Jul 02 19:56:04.440657 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.440622 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lrrqc\" (UID: \"f8c04424-7231-4f2f-bd82-8a0a7221fd4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:04.442981 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.442958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/f8c04424-7231-4f2f-bd82-8a0a7221fd4d-tls-certificates\") pod \"prometheus-operator-admission-webhook-d559d66d5-lrrqc\" (UID: \"f8c04424-7231-4f2f-bd82-8a0a7221fd4d\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:04.611200 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.611149 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:56:04.611631 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.611613 2568 scope.go:117] "RemoveContainer" containerID="1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805" Jul 02 19:56:04.611832 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:04.611809 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 20s restarting failed container=console-operator pod=console-operator-68b757fb67-l9vwb_openshift-console-operator(f3ca97ef-52b6-4db5-88e6-86162eefbb9a)\"" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" podUID="f3ca97ef-52b6-4db5-88e6-86162eefbb9a" Jul 02 19:56:04.739210 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.739124 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:04.961500 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:04.961478 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc"] Jul 02 19:56:04.963513 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:56:04.963487 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf8c04424_7231_4f2f_bd82_8a0a7221fd4d.slice/crio-99874393ded1c830d0b4bfdf7042bc3b432ea998a8516ee4acae5b0e9c6439ba WatchSource:0}: Error finding container 99874393ded1c830d0b4bfdf7042bc3b432ea998a8516ee4acae5b0e9c6439ba: Status 404 returned error can't find the container with id 99874393ded1c830d0b4bfdf7042bc3b432ea998a8516ee4acae5b0e9c6439ba Jul 02 19:56:05.769089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:05.769048 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" event={"ID":"52a8bafe-c199-4538-82c2-723d0f335b13","Type":"ContainerStarted","Data":"2d56553f67ba9603c90d109c19dd46c3305b57515a97aeabe3896a0fbec96717"} Jul 02 19:56:05.770412 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:05.770383 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" event={"ID":"f8c04424-7231-4f2f-bd82-8a0a7221fd4d","Type":"ContainerStarted","Data":"99874393ded1c830d0b4bfdf7042bc3b432ea998a8516ee4acae5b0e9c6439ba"} Jul 02 19:56:05.785644 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:05.785604 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-bq8jm" podStartSLOduration=35.088036178 podStartE2EDuration="36.785588477s" totalImagesPullingTime="1.697552299s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:55:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:05.785111903 +0000 UTC m=+75.889262997" watchObservedRunningTime="2026-07-02 19:56:05.785588477 +0000 UTC m=+75.889739570" Jul 02 19:56:06.774866 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:06.774833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" event={"ID":"f8c04424-7231-4f2f-bd82-8a0a7221fd4d","Type":"ContainerStarted","Data":"e1e8df9a36354e79c478d093dc78f4c8008e2302d1bb6ec8454b2bdc7667a649"} Jul 02 19:56:06.790967 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:06.790816 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" podStartSLOduration=2.205394407 podStartE2EDuration="3.790802378s" totalImagesPullingTime="1.585407971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:06.79052354 +0000 UTC m=+76.894674633" watchObservedRunningTime="2026-07-02 19:56:06.790802378 +0000 UTC m=+76.894953471" Jul 02 19:56:07.778231 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:07.778195 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:07.782870 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:07.782847 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-d559d66d5-lrrqc" Jul 02 19:56:13.765531 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:13.765400 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mrpc4" Jul 02 19:56:17.715568 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:17.715543 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:56:18.303796 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.303767 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-rfx7t"] Jul 02 19:56:18.306624 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.306604 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.309130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.309108 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 02 19:56:18.309331 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.309317 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 02 19:56:18.309413 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.309382 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-hgjjv\"" Jul 02 19:56:18.309413 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.309387 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 02 19:56:18.310163 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.310145 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 02 19:56:18.341690 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341654 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-metrics-client-ca\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.341835 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341711 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.341835 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341737 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-sys\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.341835 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341756 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-root\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.341835 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.342048 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341855 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-wtmp\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.342048 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-textfile\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.342048 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341934 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwp4m\" (UniqueName: \"kubernetes.io/projected/0e63189a-ff9f-4f9d-847f-189b3b2de595-kube-api-access-pwp4m\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.342048 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.341962 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.392050 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.392025 2568 scope.go:117] "RemoveContainer" containerID="1845e9eabc23f5a68a2262ac40f0b1ffc8e725ce99b101b5f22595a81e7ce805" Jul 02 19:56:18.443247 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443222 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-metrics-client-ca\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443365 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443442 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-sys\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443442 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-root\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443502 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-root\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443507 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-wtmp\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443566 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-textfile\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443628 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwp4m\" (UniqueName: \"kubernetes.io/projected/0e63189a-ff9f-4f9d-847f-189b3b2de595-kube-api-access-pwp4m\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443888 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443633 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443888 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443637 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-wtmp\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.443996 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.443979 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-metrics-client-ca\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.444054 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:18.444026 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 02 19:56:18.444054 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.444039 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-accelerators-collector-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.444162 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:18.444095 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls podName:0e63189a-ff9f-4f9d-847f-189b3b2de595 nodeName:}" failed. No retries permitted until 2026-07-02 19:56:18.944075556 +0000 UTC m=+89.048226627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls") pod "node-exporter-rfx7t" (UID: "0e63189a-ff9f-4f9d-847f-189b3b2de595") : secret "node-exporter-tls" not found Jul 02 19:56:18.444248 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.444222 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-textfile\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.444355 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.444338 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0e63189a-ff9f-4f9d-847f-189b3b2de595-sys\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.446241 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.446221 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.459185 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.459164 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwp4m\" (UniqueName: \"kubernetes.io/projected/0e63189a-ff9f-4f9d-847f-189b3b2de595-kube-api-access-pwp4m\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.820592 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.820562 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 19:56:18.821082 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.820633 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" event={"ID":"f3ca97ef-52b6-4db5-88e6-86162eefbb9a","Type":"ContainerStarted","Data":"01555b554a0e775545706d05845959350565177ef336dc2e76816887c168649c"} Jul 02 19:56:18.821082 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.820908 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:56:18.947553 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.947518 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.949871 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.949840 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0e63189a-ff9f-4f9d-847f-189b3b2de595-node-exporter-tls\") pod \"node-exporter-rfx7t\" (UID: \"0e63189a-ff9f-4f9d-847f-189b3b2de595\") " pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:18.966499 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:18.966475 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-l9vwb" Jul 02 19:56:19.216107 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:19.216067 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-rfx7t" Jul 02 19:56:19.230799 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:56:19.230555 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e63189a_ff9f_4f9d_847f_189b3b2de595.slice/crio-f413374b2d857af0399a1d783ed361dc3f309256321e9e777b98c650bd234fd6 WatchSource:0}: Error finding container f413374b2d857af0399a1d783ed361dc3f309256321e9e777b98c650bd234fd6: Status 404 returned error can't find the container with id f413374b2d857af0399a1d783ed361dc3f309256321e9e777b98c650bd234fd6 Jul 02 19:56:19.827099 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:19.827056 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfx7t" event={"ID":"0e63189a-ff9f-4f9d-847f-189b3b2de595","Type":"ContainerStarted","Data":"f413374b2d857af0399a1d783ed361dc3f309256321e9e777b98c650bd234fd6"} Jul 02 19:56:20.832098 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:20.832066 2568 generic.go:356] "Generic (PLEG): container finished" podID="0e63189a-ff9f-4f9d-847f-189b3b2de595" containerID="ff953b68b7c4b86fbf79812fa53817f5242a6d34a3f4df7d4039fe315291c5aa" exitCode=0 Jul 02 19:56:20.832474 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:20.832132 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfx7t" event={"ID":"0e63189a-ff9f-4f9d-847f-189b3b2de595","Type":"ContainerDied","Data":"ff953b68b7c4b86fbf79812fa53817f5242a6d34a3f4df7d4039fe315291c5aa"} Jul 02 19:56:21.837280 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:21.837244 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfx7t" event={"ID":"0e63189a-ff9f-4f9d-847f-189b3b2de595","Type":"ContainerStarted","Data":"6dbb3deeb0c5010ac659fa6c72276a2ec61ef54ae3aee964dea370b90f88fdb8"} Jul 02 19:56:21.837722 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:21.837335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-rfx7t" event={"ID":"0e63189a-ff9f-4f9d-847f-189b3b2de595","Type":"ContainerStarted","Data":"e64b7ac20a253c895a84c57a0ac7d57011ccaa82216f66d902725b07f1d2c161"} Jul 02 19:56:21.858038 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:21.857989 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-rfx7t" podStartSLOduration=2.864365958 podStartE2EDuration="3.857975822s" totalImagesPullingTime="929.200324ms" totalInitContainerRuntime="64.40954ms" isStatefulPod=true podCreationTimestamp="2026-07-02 19:56:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:21.856768209 +0000 UTC m=+91.960919317" watchObservedRunningTime="2026-07-02 19:56:21.857975822 +0000 UTC m=+91.962126914" Jul 02 19:56:25.102748 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:25.102712 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:56:27.714622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:27.714586 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-mtr5g" Jul 02 19:56:31.874013 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.873976 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:56:31.898924 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.898895 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:56:31.899064 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.898993 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.904427 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.904402 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 02 19:56:31.905061 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.905036 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-bpz4f\"" Jul 02 19:56:31.906910 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.906890 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 02 19:56:31.907176 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.907159 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 02 19:56:31.907241 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.907218 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 02 19:56:31.907478 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.907459 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 02 19:56:31.907570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.907499 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 02 19:56:31.907570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.907524 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 02 19:56:31.945850 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.945826 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.945970 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.945861 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.945970 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.945933 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.946070 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.945969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.946070 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.946001 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tp2jc\" (UniqueName: \"kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:31.946070 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:31.946017 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.046751 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046727 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.046898 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046762 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.046898 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046806 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tp2jc\" (UniqueName: \"kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.046898 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046829 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.047071 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.047071 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.046938 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.047528 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.047504 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.047620 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.047555 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.047620 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.047561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.049216 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.049189 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.049306 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.049196 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.054691 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.054667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tp2jc\" (UniqueName: \"kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc\") pod \"console-7d8c766c48-pg6j5\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.211934 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.211856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:32.376561 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.376509 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:56:32.379021 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:56:32.378982 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod402aa4a6_ee96_4320_a301_f014d6b0354a.slice/crio-84813545eadafa5b99e6d6a9b9855d451595bdd3f0a959ea5626ad03a8ab5761 WatchSource:0}: Error finding container 84813545eadafa5b99e6d6a9b9855d451595bdd3f0a959ea5626ad03a8ab5761: Status 404 returned error can't find the container with id 84813545eadafa5b99e6d6a9b9855d451595bdd3f0a959ea5626ad03a8ab5761 Jul 02 19:56:32.879550 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:32.879514 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c766c48-pg6j5" event={"ID":"402aa4a6-ee96-4320-a301-f014d6b0354a","Type":"ContainerStarted","Data":"84813545eadafa5b99e6d6a9b9855d451595bdd3f0a959ea5626ad03a8ab5761"} Jul 02 19:56:36.897219 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:36.897188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c766c48-pg6j5" event={"ID":"402aa4a6-ee96-4320-a301-f014d6b0354a","Type":"ContainerStarted","Data":"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd"} Jul 02 19:56:36.916189 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:36.916142 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8c766c48-pg6j5" podStartSLOduration=2.285483249 podStartE2EDuration="5.916126476s" totalImagesPullingTime="3.630643227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:36.914763985 +0000 UTC m=+107.018915114" watchObservedRunningTime="2026-07-02 19:56:36.916126476 +0000 UTC m=+107.020277569" Jul 02 19:56:40.250802 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.250766 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:56:40.254301 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.254284 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.262672 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.262645 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 02 19:56:40.264184 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.264165 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:56:40.318368 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318368 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318368 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318390 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54qp2\" (UniqueName: \"kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318456 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318521 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318533 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.318618 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.318575 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419285 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419431 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419296 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419431 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419315 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54qp2\" (UniqueName: \"kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419431 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419431 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419366 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419431 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419399 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.419691 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.419431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.420107 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.420076 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.420232 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.420110 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.420232 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.420130 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.420348 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.420229 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.421893 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.421858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.422014 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.421969 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.428215 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.428187 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54qp2\" (UniqueName: \"kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2\") pod \"console-98567c4f8-v4rrx\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.563963 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.563891 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:40.688679 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.688653 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:56:40.690667 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:56:40.690632 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8513ac9_9adb_4f92_9f7e_f06ed846c364.slice/crio-bcf071cf62b7cd3c9eaa251306130a26b4a1834059d2c3722bd6a4395aa7245e WatchSource:0}: Error finding container bcf071cf62b7cd3c9eaa251306130a26b4a1834059d2c3722bd6a4395aa7245e: Status 404 returned error can't find the container with id bcf071cf62b7cd3c9eaa251306130a26b4a1834059d2c3722bd6a4395aa7245e Jul 02 19:56:40.912750 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.912708 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98567c4f8-v4rrx" event={"ID":"b8513ac9-9adb-4f92-9f7e-f06ed846c364","Type":"ContainerStarted","Data":"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273"} Jul 02 19:56:40.912933 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.912767 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98567c4f8-v4rrx" event={"ID":"b8513ac9-9adb-4f92-9f7e-f06ed846c364","Type":"ContainerStarted","Data":"bcf071cf62b7cd3c9eaa251306130a26b4a1834059d2c3722bd6a4395aa7245e"} Jul 02 19:56:40.931931 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:40.931869 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-98567c4f8-v4rrx" podStartSLOduration=0.931854028 podStartE2EDuration="931.854028ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:56:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:56:40.930272696 +0000 UTC m=+111.034423790" watchObservedRunningTime="2026-07-02 19:56:40.931854028 +0000 UTC m=+111.036005121" Jul 02 19:56:42.212136 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:42.212100 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:42.212583 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:42.212214 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:42.216854 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:42.216833 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:42.923282 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:42.923254 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:56:50.122524 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.122465 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" podUID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" containerName="registry" containerID="cri-o://71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2" gracePeriod=30 Jul 02 19:56:50.390334 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.390313 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:56:50.503567 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503539 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503715 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503575 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503715 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503606 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503715 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503634 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503715 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503651 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h2tcg\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503715 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503696 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503742 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.503988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.503789 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates\") pod \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\" (UID: \"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620\") " Jul 02 19:56:50.504179 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.504151 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:56:50.504315 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.504284 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:56:50.506169 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.506132 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:50.506312 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.506198 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:56:50.506312 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.506294 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg" (OuterVolumeSpecName: "kube-api-access-h2tcg") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "kube-api-access-h2tcg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:50.506631 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.506599 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:56:50.506703 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.506628 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:56:50.512093 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.512067 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" (UID: "b7af0dc6-5f05-41e3-b40a-f2dce0f8b620"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:56:50.564591 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.564564 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:50.564682 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.564612 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:50.569191 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.569172 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:50.604375 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604352 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-installation-pull-secrets\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604379 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-image-registry-private-configuration\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604393 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-bound-sa-token\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604404 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-trusted-ca\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604414 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h2tcg\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-kube-api-access-h2tcg\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604425 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-tls\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604438 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-ca-trust-extracted\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.604462 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.604451 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620-registry-certificates\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:56:50.953143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.953112 2568 generic.go:356] "Generic (PLEG): container finished" podID="1d99a682-0a3a-45f2-9809-f62cfd3a1096" containerID="ce87976865e90178082eb398103f723ffd0b5ef587f29089d096582c4443b039" exitCode=0 Jul 02 19:56:50.953326 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.953190 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" event={"ID":"1d99a682-0a3a-45f2-9809-f62cfd3a1096","Type":"ContainerDied","Data":"ce87976865e90178082eb398103f723ffd0b5ef587f29089d096582c4443b039"} Jul 02 19:56:50.953572 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.953547 2568 scope.go:117] "RemoveContainer" containerID="ce87976865e90178082eb398103f723ffd0b5ef587f29089d096582c4443b039" Jul 02 19:56:50.954365 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.954345 2568 generic.go:356] "Generic (PLEG): container finished" podID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" containerID="71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2" exitCode=0 Jul 02 19:56:50.954444 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.954429 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" Jul 02 19:56:50.954491 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.954480 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" event={"ID":"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620","Type":"ContainerDied","Data":"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2"} Jul 02 19:56:50.954532 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.954516 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5d8784f8cb-cdgpc" event={"ID":"b7af0dc6-5f05-41e3-b40a-f2dce0f8b620","Type":"ContainerDied","Data":"3b314597df24296874892300532f0047add723a9baf464d296aba650955a1e9c"} Jul 02 19:56:50.954569 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.954539 2568 scope.go:117] "RemoveContainer" containerID="71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2" Jul 02 19:56:50.958659 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.958640 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:56:50.963950 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.963935 2568 scope.go:117] "RemoveContainer" containerID="71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2" Jul 02 19:56:50.964209 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:56:50.964192 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2\": container with ID starting with 71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2 not found: ID does not exist" containerID="71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2" Jul 02 19:56:50.964251 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:50.964216 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2"} err="failed to get container status \"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2\": rpc error: code = NotFound desc = could not find container \"71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2\": container with ID starting with 71255c96bacce07aa36f87e6d08c307934d6a03334c9b567de4d77477ac735f2 not found: ID does not exist" Jul 02 19:56:51.010823 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:51.010797 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:56:51.016384 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:51.016313 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-5d8784f8cb-cdgpc"] Jul 02 19:56:51.023575 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:51.023554 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:56:51.960181 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:51.960150 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-hfcgh" event={"ID":"1d99a682-0a3a-45f2-9809-f62cfd3a1096","Type":"ContainerStarted","Data":"7249e017915992d49a66cd4ccdfd450861d4c662966a196f890d74ce9af3d35a"} Jul 02 19:56:52.396694 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:56:52.396661 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" path="/var/lib/kubelet/pods/b7af0dc6-5f05-41e3-b40a-f2dce0f8b620/volumes" Jul 02 19:57:00.996445 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:00.996364 2568 generic.go:356] "Generic (PLEG): container finished" podID="c0e351b6-6ed5-4b60-b95f-8ec72d419991" containerID="0dbeb290938f52edcc1654ffa22a643dd96730c61d9d2d7ab6e869dbc6c65053" exitCode=0 Jul 02 19:57:00.996812 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:00.996439 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" event={"ID":"c0e351b6-6ed5-4b60-b95f-8ec72d419991","Type":"ContainerDied","Data":"0dbeb290938f52edcc1654ffa22a643dd96730c61d9d2d7ab6e869dbc6c65053"} Jul 02 19:57:00.996812 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:00.996744 2568 scope.go:117] "RemoveContainer" containerID="0dbeb290938f52edcc1654ffa22a643dd96730c61d9d2d7ab6e869dbc6c65053" Jul 02 19:57:02.001448 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:02.001406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-7q4nd" event={"ID":"c0e351b6-6ed5-4b60-b95f-8ec72d419991","Type":"ContainerStarted","Data":"7c881998e8b0f290f0dab56a77b667d0aca07e5448874ceaeaae24e19506dcc3"} Jul 02 19:57:06.016365 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:06.016328 2568 generic.go:356] "Generic (PLEG): container finished" podID="461340a3-9650-4d9d-9e84-e55eaee364be" containerID="662beeca9fe5d1a1c4b779d8b811f548548f91158009620eba2c4c7743d2f64f" exitCode=0 Jul 02 19:57:06.016829 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:06.016370 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" event={"ID":"461340a3-9650-4d9d-9e84-e55eaee364be","Type":"ContainerDied","Data":"662beeca9fe5d1a1c4b779d8b811f548548f91158009620eba2c4c7743d2f64f"} Jul 02 19:57:06.016829 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:06.016768 2568 scope.go:117] "RemoveContainer" containerID="662beeca9fe5d1a1c4b779d8b811f548548f91158009620eba2c4c7743d2f64f" Jul 02 19:57:07.021393 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:07.021359 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-sn759" event={"ID":"461340a3-9650-4d9d-9e84-e55eaee364be","Type":"ContainerStarted","Data":"95a663bf6985a44f14483f613a2ad51a0f1b79b8481bc825117bea04b372af37"} Jul 02 19:57:16.046988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.046931 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d8c766c48-pg6j5" podUID="402aa4a6-ee96-4320-a301-f014d6b0354a" containerName="console" containerID="cri-o://10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd" gracePeriod=15 Jul 02 19:57:16.294173 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.293000 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:57:16.294173 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.293373 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" containerName="registry" Jul 02 19:57:16.294173 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.293388 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" containerName="registry" Jul 02 19:57:16.294173 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.293456 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b7af0dc6-5f05-41e3-b40a-f2dce0f8b620" containerName="registry" Jul 02 19:57:16.296276 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.296254 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:57:16.297110 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.297065 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.306342 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.306315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:57:16.402890 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.402850 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403057 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.402922 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403057 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.402968 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403057 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.402998 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403057 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403032 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tp2jc\" (UniqueName: \"kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403262 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403061 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert\") pod \"402aa4a6-ee96-4320-a301-f014d6b0354a\" (UID: \"402aa4a6-ee96-4320-a301-f014d6b0354a\") " Jul 02 19:57:16.403262 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403180 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlltk\" (UniqueName: \"kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403262 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403217 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config" (OuterVolumeSpecName: "console-config") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:16.403391 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403255 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca" (OuterVolumeSpecName: "service-ca") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:16.403391 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403263 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403497 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403419 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403497 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403497 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403476 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403497 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403472 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:16.403742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403533 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403559 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.403742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403619 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-oauth-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.403742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403637 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-console-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.403742 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.403646 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/402aa4a6-ee96-4320-a301-f014d6b0354a-service-ca\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.405332 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.405313 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:57:16.405563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.405539 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc" (OuterVolumeSpecName: "kube-api-access-tp2jc") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "kube-api-access-tp2jc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:57:16.405563 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.405548 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "402aa4a6-ee96-4320-a301-f014d6b0354a" (UID: "402aa4a6-ee96-4320-a301-f014d6b0354a"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:57:16.504498 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504468 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504498 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504519 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504586 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504634 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlltk\" (UniqueName: \"kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.504851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504748 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tp2jc\" (UniqueName: \"kubernetes.io/projected/402aa4a6-ee96-4320-a301-f014d6b0354a-kube-api-access-tp2jc\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.504851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504767 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.504851 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.504780 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/402aa4a6-ee96-4320-a301-f014d6b0354a-console-oauth-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:16.505338 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.505312 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.505437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.505336 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.505437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.505319 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.505528 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.505512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.506997 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.506975 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.507130 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.507114 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.512379 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.512357 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlltk\" (UniqueName: \"kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk\") pod \"console-6c745959f-bjjjv\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.609058 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.608990 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:16.733454 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:16.733431 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:57:16.735083 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:57:16.735059 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1bcbc225_7cbc_4425_8e1a_c870d5310540.slice/crio-0f33c3df65e3b7cece5f95c52905deb5349642b39e0b45c24f69ec2d11db60b4 WatchSource:0}: Error finding container 0f33c3df65e3b7cece5f95c52905deb5349642b39e0b45c24f69ec2d11db60b4: Status 404 returned error can't find the container with id 0f33c3df65e3b7cece5f95c52905deb5349642b39e0b45c24f69ec2d11db60b4 Jul 02 19:57:17.058238 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.058209 2568 generic.go:356] "Generic (PLEG): container finished" podID="402aa4a6-ee96-4320-a301-f014d6b0354a" containerID="10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd" exitCode=0 Jul 02 19:57:17.058666 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.058250 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c766c48-pg6j5" Jul 02 19:57:17.058666 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.058292 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c766c48-pg6j5" event={"ID":"402aa4a6-ee96-4320-a301-f014d6b0354a","Type":"ContainerDied","Data":"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd"} Jul 02 19:57:17.058666 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.058341 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c766c48-pg6j5" event={"ID":"402aa4a6-ee96-4320-a301-f014d6b0354a","Type":"ContainerDied","Data":"84813545eadafa5b99e6d6a9b9855d451595bdd3f0a959ea5626ad03a8ab5761"} Jul 02 19:57:17.058666 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.058369 2568 scope.go:117] "RemoveContainer" containerID="10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd" Jul 02 19:57:17.060163 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.060130 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c745959f-bjjjv" event={"ID":"1bcbc225-7cbc-4425-8e1a-c870d5310540","Type":"ContainerStarted","Data":"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02"} Jul 02 19:57:17.060270 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.060194 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c745959f-bjjjv" event={"ID":"1bcbc225-7cbc-4425-8e1a-c870d5310540","Type":"ContainerStarted","Data":"0f33c3df65e3b7cece5f95c52905deb5349642b39e0b45c24f69ec2d11db60b4"} Jul 02 19:57:17.072318 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.072301 2568 scope.go:117] "RemoveContainer" containerID="10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd" Jul 02 19:57:17.072562 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:57:17.072544 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd\": container with ID starting with 10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd not found: ID does not exist" containerID="10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd" Jul 02 19:57:17.072633 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.072573 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd"} err="failed to get container status \"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd\": rpc error: code = NotFound desc = could not find container \"10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd\": container with ID starting with 10b10fe005a36447f6d82e65662f1ec713e129610487881d8fc7546793dbc6fd not found: ID does not exist" Jul 02 19:57:17.081481 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.081433 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c745959f-bjjjv" podStartSLOduration=1.081411594 podStartE2EDuration="1.081411594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:57:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:57:17.080308513 +0000 UTC m=+147.184459606" watchObservedRunningTime="2026-07-02 19:57:17.081411594 +0000 UTC m=+147.185562687" Jul 02 19:57:17.099893 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.095473 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:57:17.103352 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:17.103326 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8c766c48-pg6j5"] Jul 02 19:57:18.400288 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:18.400254 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="402aa4a6-ee96-4320-a301-f014d6b0354a" path="/var/lib/kubelet/pods/402aa4a6-ee96-4320-a301-f014d6b0354a/volumes" Jul 02 19:57:26.609426 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:26.609391 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:26.609863 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:26.609456 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:26.614011 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:26.613989 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:27.103199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:27.103169 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:57:27.162733 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:27.162698 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:57:52.185028 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.184965 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-98567c4f8-v4rrx" podUID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" containerName="console" containerID="cri-o://8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273" gracePeriod=15 Jul 02 19:57:52.432927 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.432903 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:57:52.608143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608063 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608104 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608133 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608178 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608205 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-54qp2\" (UniqueName: \"kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608263 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608400 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608324 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert\") pod \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\" (UID: \"b8513ac9-9adb-4f92-9f7e-f06ed846c364\") " Jul 02 19:57:52.608606 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608571 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca" (OuterVolumeSpecName: "service-ca") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:52.608665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608604 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:52.608665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608616 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:52.608771 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.608688 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config" (OuterVolumeSpecName: "console-config") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:57:52.610210 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.610179 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:57:52.610423 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.610405 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:57:52.610502 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.610480 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2" (OuterVolumeSpecName: "kube-api-access-54qp2") pod "b8513ac9-9adb-4f92-9f7e-f06ed846c364" (UID: "b8513ac9-9adb-4f92-9f7e-f06ed846c364"). InnerVolumeSpecName "kube-api-access-54qp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:57:52.709827 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709798 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.709827 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709820 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.709827 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709830 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b8513ac9-9adb-4f92-9f7e-f06ed846c364-console-oauth-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.710029 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709841 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-service-ca\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.710029 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709850 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-oauth-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.710029 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709858 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b8513ac9-9adb-4f92-9f7e-f06ed846c364-trusted-ca-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:52.710029 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:52.709867 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-54qp2\" (UniqueName: \"kubernetes.io/projected/b8513ac9-9adb-4f92-9f7e-f06ed846c364-kube-api-access-54qp2\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:57:53.196583 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.196548 2568 generic.go:356] "Generic (PLEG): container finished" podID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" containerID="8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273" exitCode=0 Jul 02 19:57:53.197112 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.196603 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-98567c4f8-v4rrx" Jul 02 19:57:53.197112 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.196617 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98567c4f8-v4rrx" event={"ID":"b8513ac9-9adb-4f92-9f7e-f06ed846c364","Type":"ContainerDied","Data":"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273"} Jul 02 19:57:53.197112 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.196653 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-98567c4f8-v4rrx" event={"ID":"b8513ac9-9adb-4f92-9f7e-f06ed846c364","Type":"ContainerDied","Data":"bcf071cf62b7cd3c9eaa251306130a26b4a1834059d2c3722bd6a4395aa7245e"} Jul 02 19:57:53.197112 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.196672 2568 scope.go:117] "RemoveContainer" containerID="8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273" Jul 02 19:57:53.204640 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.204617 2568 scope.go:117] "RemoveContainer" containerID="8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273" Jul 02 19:57:53.204989 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:57:53.204967 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273\": container with ID starting with 8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273 not found: ID does not exist" containerID="8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273" Jul 02 19:57:53.205051 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.204998 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273"} err="failed to get container status \"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273\": rpc error: code = NotFound desc = could not find container \"8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273\": container with ID starting with 8af2ff035fb98ebe33906907dd59438f1aa5ecb2f86432b97249b1338a01d273 not found: ID does not exist" Jul 02 19:57:53.218774 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.218746 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:57:53.223148 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:53.223127 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-98567c4f8-v4rrx"] Jul 02 19:57:54.396134 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:57:54.396101 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" path="/var/lib/kubelet/pods/b8513ac9-9adb-4f92-9f7e-f06ed846c364/volumes" Jul 02 19:59:00.124270 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124235 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx"] Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124517 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="402aa4a6-ee96-4320-a301-f014d6b0354a" containerName="console" Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124527 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="402aa4a6-ee96-4320-a301-f014d6b0354a" containerName="console" Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124535 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" containerName="console" Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124540 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" containerName="console" Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124595 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="402aa4a6-ee96-4320-a301-f014d6b0354a" containerName="console" Jul 02 19:59:00.124723 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.124603 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8513ac9-9adb-4f92-9f7e-f06ed846c364" containerName="console" Jul 02 19:59:00.128570 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.128553 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.131308 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.131288 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:59:00.131418 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.131365 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:59:00.132473 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.132445 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6shcc\"" Jul 02 19:59:00.138452 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.138433 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx"] Jul 02 19:59:00.290221 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.290189 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.290221 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.290220 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.290414 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.290253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ljfs7\" (UniqueName: \"kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.390630 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.390553 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.390630 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.390594 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.390630 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.390628 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ljfs7\" (UniqueName: \"kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.390941 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.390925 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.390988 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.390968 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.399319 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.399296 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ljfs7\" (UniqueName: \"kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.437590 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.437564 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:00.559242 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:00.559217 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx"] Jul 02 19:59:00.561787 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:00.561761 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda85a68ec_7be7_4d3e_9d12_95685fc850c6.slice/crio-195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9 WatchSource:0}: Error finding container 195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9: Status 404 returned error can't find the container with id 195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9 Jul 02 19:59:01.437818 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:01.437783 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" event={"ID":"a85a68ec-7be7-4d3e-9d12-95685fc850c6","Type":"ContainerStarted","Data":"195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9"} Jul 02 19:59:07.462483 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:07.462443 2568 generic.go:356] "Generic (PLEG): container finished" podID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerID="aeb44bd5508eaf057257839e0e3acbd8451515c69785304aff0767ef002ace14" exitCode=0 Jul 02 19:59:07.462838 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:07.462535 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" event={"ID":"a85a68ec-7be7-4d3e-9d12-95685fc850c6","Type":"ContainerDied","Data":"aeb44bd5508eaf057257839e0e3acbd8451515c69785304aff0767ef002ace14"} Jul 02 19:59:10.288393 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.288362 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 19:59:10.291671 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.291644 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.304564 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.304535 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 19:59:10.480588 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480557 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480752 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480606 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480752 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480630 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480752 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480710 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480752 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480739 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480965 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480759 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.480965 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.480789 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9z2k8\" (UniqueName: \"kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.481795 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.481769 2568 generic.go:356] "Generic (PLEG): container finished" podID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerID="ba140458e6ef64d62b6f70f131d465811a84a630b6e2b8fe5b95e4b7669a2aa7" exitCode=0 Jul 02 19:59:10.481909 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.481833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" event={"ID":"a85a68ec-7be7-4d3e-9d12-95685fc850c6","Type":"ContainerDied","Data":"ba140458e6ef64d62b6f70f131d465811a84a630b6e2b8fe5b95e4b7669a2aa7"} Jul 02 19:59:10.581615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581615 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581845 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581620 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9z2k8\" (UniqueName: \"kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581845 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581640 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581845 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581670 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.581845 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.581692 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.582453 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.582428 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.582554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.582465 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.582692 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.582671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.583083 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.583059 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.584196 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.584173 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.584357 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.584337 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.590170 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.590150 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9z2k8\" (UniqueName: \"kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8\") pod \"console-6c456d9b8-tzzxq\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.600804 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.600786 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:10.727358 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:10.727331 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 19:59:10.729120 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:10.729092 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2eeeeaf5_087a_4f7d_ae3b_de9538831a4f.slice/crio-52a645760829dba8446fdb4c26d69547a2f8447402ffa6cddf49b1cc861bf22c WatchSource:0}: Error finding container 52a645760829dba8446fdb4c26d69547a2f8447402ffa6cddf49b1cc861bf22c: Status 404 returned error can't find the container with id 52a645760829dba8446fdb4c26d69547a2f8447402ffa6cddf49b1cc861bf22c Jul 02 19:59:11.488301 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:11.488261 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c456d9b8-tzzxq" event={"ID":"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f","Type":"ContainerStarted","Data":"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4"} Jul 02 19:59:11.488716 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:11.488315 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c456d9b8-tzzxq" event={"ID":"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f","Type":"ContainerStarted","Data":"52a645760829dba8446fdb4c26d69547a2f8447402ffa6cddf49b1cc861bf22c"} Jul 02 19:59:11.507385 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:11.507326 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c456d9b8-tzzxq" podStartSLOduration=1.507305627 podStartE2EDuration="1.507305627s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:11.504951013 +0000 UTC m=+261.609102107" watchObservedRunningTime="2026-07-02 19:59:11.507305627 +0000 UTC m=+261.611456722" Jul 02 19:59:18.517433 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:18.517397 2568 generic.go:356] "Generic (PLEG): container finished" podID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerID="ef0a7bb3b3cb9610c60b954cbd6bc0ee3a26ecaec4f2143da5e1b9fd008a44fc" exitCode=0 Jul 02 19:59:18.517815 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:18.517496 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" event={"ID":"a85a68ec-7be7-4d3e-9d12-95685fc850c6","Type":"ContainerDied","Data":"ef0a7bb3b3cb9610c60b954cbd6bc0ee3a26ecaec4f2143da5e1b9fd008a44fc"} Jul 02 19:59:19.645761 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.645736 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:19.748836 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.748810 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ljfs7\" (UniqueName: \"kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7\") pod \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " Jul 02 19:59:19.748996 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.748897 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util\") pod \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " Jul 02 19:59:19.748996 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.748949 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle\") pod \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\" (UID: \"a85a68ec-7be7-4d3e-9d12-95685fc850c6\") " Jul 02 19:59:19.749679 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.749647 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle" (OuterVolumeSpecName: "bundle") pod "a85a68ec-7be7-4d3e-9d12-95685fc850c6" (UID: "a85a68ec-7be7-4d3e-9d12-95685fc850c6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:19.751127 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.751101 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7" (OuterVolumeSpecName: "kube-api-access-ljfs7") pod "a85a68ec-7be7-4d3e-9d12-95685fc850c6" (UID: "a85a68ec-7be7-4d3e-9d12-95685fc850c6"). InnerVolumeSpecName "kube-api-access-ljfs7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:19.754199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.754180 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util" (OuterVolumeSpecName: "util") pod "a85a68ec-7be7-4d3e-9d12-95685fc850c6" (UID: "a85a68ec-7be7-4d3e-9d12-95685fc850c6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:19.850437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.850351 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ljfs7\" (UniqueName: \"kubernetes.io/projected/a85a68ec-7be7-4d3e-9d12-95685fc850c6-kube-api-access-ljfs7\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:19.850437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.850382 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:19.850437 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:19.850394 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/a85a68ec-7be7-4d3e-9d12-95685fc850c6-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:20.526663 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.526629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" event={"ID":"a85a68ec-7be7-4d3e-9d12-95685fc850c6","Type":"ContainerDied","Data":"195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9"} Jul 02 19:59:20.526822 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.526673 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540p7wmx" Jul 02 19:59:20.526822 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.526702 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="195a2742e95707c169a32cb692987bc49155db73566035e69b30e14d600689c9" Jul 02 19:59:20.600978 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.600947 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:20.601143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.601009 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:20.605724 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:20.605701 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:21.534059 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:21.534028 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 19:59:21.590498 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:21.590469 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:59:28.140222 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140187 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m"] Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140462 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="extract" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140474 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="extract" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140491 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="pull" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140498 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="pull" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140514 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="util" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140519 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="util" Jul 02 19:59:28.140598 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.140560 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a85a68ec-7be7-4d3e-9d12-95685fc850c6" containerName="extract" Jul 02 19:59:28.143649 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.143633 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.146960 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.146941 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-wqmjk\"" Jul 02 19:59:28.147266 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.147248 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 02 19:59:28.147358 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.147280 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 02 19:59:28.159730 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.159709 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m"] Jul 02 19:59:28.219010 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.218985 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-592hs\" (UniqueName: \"kubernetes.io/projected/b2d16438-25cc-4758-b32f-3b27c0885dce-kube-api-access-592hs\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.219135 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.219050 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d16438-25cc-4758-b32f-3b27c0885dce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.319688 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.319627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d16438-25cc-4758-b32f-3b27c0885dce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.319688 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.319683 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-592hs\" (UniqueName: \"kubernetes.io/projected/b2d16438-25cc-4758-b32f-3b27c0885dce-kube-api-access-592hs\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.320009 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.319993 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b2d16438-25cc-4758-b32f-3b27c0885dce-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.330967 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.330937 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-592hs\" (UniqueName: \"kubernetes.io/projected/b2d16438-25cc-4758-b32f-3b27c0885dce-kube-api-access-592hs\") pod \"cert-manager-operator-controller-manager-55c444bf86-c9d6m\" (UID: \"b2d16438-25cc-4758-b32f-3b27c0885dce\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.452525 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.452495 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" Jul 02 19:59:28.584556 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:28.584527 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m"] Jul 02 19:59:28.586279 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:28.586248 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2d16438_25cc_4758_b32f_3b27c0885dce.slice/crio-55cff90521726915ce48ee139fec4a4c518616d1e19ff75b353aa1fedf9c521e WatchSource:0}: Error finding container 55cff90521726915ce48ee139fec4a4c518616d1e19ff75b353aa1fedf9c521e: Status 404 returned error can't find the container with id 55cff90521726915ce48ee139fec4a4c518616d1e19ff75b353aa1fedf9c521e Jul 02 19:59:29.561377 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:29.561343 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" event={"ID":"b2d16438-25cc-4758-b32f-3b27c0885dce","Type":"ContainerStarted","Data":"55cff90521726915ce48ee139fec4a4c518616d1e19ff75b353aa1fedf9c521e"} Jul 02 19:59:32.576761 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:32.576723 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" event={"ID":"b2d16438-25cc-4758-b32f-3b27c0885dce","Type":"ContainerStarted","Data":"d877d85299f3775639ec7ad582004983ea4c407539d679d585dad3f1be3fe715"} Jul 02 19:59:32.598298 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:32.598240 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-c9d6m" podStartSLOduration=0.803004899 podStartE2EDuration="4.598225596s" totalImagesPullingTime="3.795220697s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:32.596146612 +0000 UTC m=+282.700297706" watchObservedRunningTime="2026-07-02 19:59:32.598225596 +0000 UTC m=+282.702376688" Jul 02 19:59:33.375281 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.375248 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7"] Jul 02 19:59:33.377770 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.377741 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.381265 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.381236 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:59:33.381385 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.381337 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6shcc\"" Jul 02 19:59:33.382418 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.382397 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:59:33.396453 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.396426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7"] Jul 02 19:59:33.458448 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.458418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.458607 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.458475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.458607 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.458550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2gddk\" (UniqueName: \"kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.558925 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.558859 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.559086 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.559031 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2gddk\" (UniqueName: \"kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.559141 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.559122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.559283 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.559268 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.559451 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.559433 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.577646 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.577610 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2gddk\" (UniqueName: \"kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.689355 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.689283 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:33.813945 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:33.813923 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7"] Jul 02 19:59:33.815903 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:33.815866 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeeac35a_030c_4464_9c93_43b9203ad78f.slice/crio-816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6 WatchSource:0}: Error finding container 816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6: Status 404 returned error can't find the container with id 816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6 Jul 02 19:59:34.054527 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.054448 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmrxs"] Jul 02 19:59:34.060725 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.060699 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.063489 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.063467 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-jxnw5\"" Jul 02 19:59:34.063622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.063467 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 02 19:59:34.063622 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.063505 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 02 19:59:34.068592 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.068567 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmrxs"] Jul 02 19:59:34.163929 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.163871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.164077 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.163972 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d9cm\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-kube-api-access-8d9cm\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.264460 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.264423 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.264603 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.264487 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d9cm\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-kube-api-access-8d9cm\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.273042 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.273010 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.273150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.273121 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d9cm\" (UniqueName: \"kubernetes.io/projected/0a7a039c-4e8d-442a-a094-a57c50152e8b-kube-api-access-8d9cm\") pod \"cert-manager-webhook-6486ffd997-tmrxs\" (UID: \"0a7a039c-4e8d-442a-a094-a57c50152e8b\") " pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.384964 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.384935 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:34.506998 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.506975 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-tmrxs"] Jul 02 19:59:34.509198 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:34.509171 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0a7a039c_4e8d_442a_a094_a57c50152e8b.slice/crio-9ea5cfc8a397e75984a2f116c64eac4dc5c914c9f576a8ed20f6795243ffd465 WatchSource:0}: Error finding container 9ea5cfc8a397e75984a2f116c64eac4dc5c914c9f576a8ed20f6795243ffd465: Status 404 returned error can't find the container with id 9ea5cfc8a397e75984a2f116c64eac4dc5c914c9f576a8ed20f6795243ffd465 Jul 02 19:59:34.586637 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.586606 2568 generic.go:356] "Generic (PLEG): container finished" podID="feeac35a-030c-4464-9c93-43b9203ad78f" containerID="909bf58636db8e2cad9eebe7299c7df949c2be67bef78cf4f668ecec614b2967" exitCode=0 Jul 02 19:59:34.587058 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.586692 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" event={"ID":"feeac35a-030c-4464-9c93-43b9203ad78f","Type":"ContainerDied","Data":"909bf58636db8e2cad9eebe7299c7df949c2be67bef78cf4f668ecec614b2967"} Jul 02 19:59:34.587058 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.586764 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" event={"ID":"feeac35a-030c-4464-9c93-43b9203ad78f","Type":"ContainerStarted","Data":"816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6"} Jul 02 19:59:34.588392 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:34.588365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" event={"ID":"0a7a039c-4e8d-442a-a094-a57c50152e8b","Type":"ContainerStarted","Data":"9ea5cfc8a397e75984a2f116c64eac4dc5c914c9f576a8ed20f6795243ffd465"} Jul 02 19:59:35.857132 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.857095 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n695k"] Jul 02 19:59:35.859459 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.859436 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:35.862089 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.862070 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-4d756\"" Jul 02 19:59:35.870856 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.870810 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n695k"] Jul 02 19:59:35.978251 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.978215 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:35.978410 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:35.978308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcp86\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-kube-api-access-qcp86\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:36.079412 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:36.079381 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:36.079579 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:36.079448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcp86\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-kube-api-access-qcp86\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:36.088810 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:36.088749 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:36.088951 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:36.088929 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcp86\" (UniqueName: \"kubernetes.io/projected/8257c1bf-800f-4f12-811d-5b9895939915-kube-api-access-qcp86\") pod \"cert-manager-cainjector-559cdd8c87-n695k\" (UID: \"8257c1bf-800f-4f12-811d-5b9895939915\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:36.170315 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:36.170286 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" Jul 02 19:59:37.210076 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.210046 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-n695k"] Jul 02 19:59:37.212622 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:37.212594 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8257c1bf_800f_4f12_811d_5b9895939915.slice/crio-8ccd348b44bd6bbba4eecb5fee78eb935f4a122616a80c61c5126051616ca7ca WatchSource:0}: Error finding container 8ccd348b44bd6bbba4eecb5fee78eb935f4a122616a80c61c5126051616ca7ca: Status 404 returned error can't find the container with id 8ccd348b44bd6bbba4eecb5fee78eb935f4a122616a80c61c5126051616ca7ca Jul 02 19:59:37.604632 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.604555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" event={"ID":"8257c1bf-800f-4f12-811d-5b9895939915","Type":"ContainerStarted","Data":"d4e5c12a045cb7fc7f5855c960683f21a5750cd21ed7aacce7fca9c829c0e659"} Jul 02 19:59:37.604632 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.604605 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" event={"ID":"8257c1bf-800f-4f12-811d-5b9895939915","Type":"ContainerStarted","Data":"8ccd348b44bd6bbba4eecb5fee78eb935f4a122616a80c61c5126051616ca7ca"} Jul 02 19:59:37.606339 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.606299 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" event={"ID":"0a7a039c-4e8d-442a-a094-a57c50152e8b","Type":"ContainerStarted","Data":"a411ce9023630d4fcbe06af31885532a02b187a30b88feb294e3b53683303ce0"} Jul 02 19:59:37.606464 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.606421 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:37.628221 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.628167 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-n695k" podStartSLOduration=2.628154361 podStartE2EDuration="2.628154361s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:37.626141074 +0000 UTC m=+287.730292170" watchObservedRunningTime="2026-07-02 19:59:37.628154361 +0000 UTC m=+287.732305454" Jul 02 19:59:37.644128 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:37.644077 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" podStartSLOduration=1.040832794 podStartE2EDuration="3.644058897s" totalImagesPullingTime="2.603226103s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 19:59:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 19:59:37.64306367 +0000 UTC m=+287.747214763" watchObservedRunningTime="2026-07-02 19:59:37.644058897 +0000 UTC m=+287.748209993" Jul 02 19:59:38.612154 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:38.612128 2568 generic.go:356] "Generic (PLEG): container finished" podID="feeac35a-030c-4464-9c93-43b9203ad78f" containerID="d627b7dca3b97c49c2dbdad1082f260a659954a37b9d2e4807704e39cf7d449c" exitCode=0 Jul 02 19:59:38.612492 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:38.612215 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" event={"ID":"feeac35a-030c-4464-9c93-43b9203ad78f","Type":"ContainerDied","Data":"d627b7dca3b97c49c2dbdad1082f260a659954a37b9d2e4807704e39cf7d449c"} Jul 02 19:59:39.618905 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:39.618853 2568 generic.go:356] "Generic (PLEG): container finished" podID="feeac35a-030c-4464-9c93-43b9203ad78f" containerID="57721c2d775d9c1cc7f0d7702d27488e05c89a9ff53b7f8215eab0b80d169390" exitCode=0 Jul 02 19:59:39.619260 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:39.618910 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" event={"ID":"feeac35a-030c-4464-9c93-43b9203ad78f","Type":"ContainerDied","Data":"57721c2d775d9c1cc7f0d7702d27488e05c89a9ff53b7f8215eab0b80d169390"} Jul 02 19:59:40.748546 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.748523 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:40.819770 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.819743 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle\") pod \"feeac35a-030c-4464-9c93-43b9203ad78f\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " Jul 02 19:59:40.819953 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.819779 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2gddk\" (UniqueName: \"kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk\") pod \"feeac35a-030c-4464-9c93-43b9203ad78f\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " Jul 02 19:59:40.819953 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.819807 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util\") pod \"feeac35a-030c-4464-9c93-43b9203ad78f\" (UID: \"feeac35a-030c-4464-9c93-43b9203ad78f\") " Jul 02 19:59:40.820366 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.820333 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle" (OuterVolumeSpecName: "bundle") pod "feeac35a-030c-4464-9c93-43b9203ad78f" (UID: "feeac35a-030c-4464-9c93-43b9203ad78f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:40.822002 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.821978 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk" (OuterVolumeSpecName: "kube-api-access-2gddk") pod "feeac35a-030c-4464-9c93-43b9203ad78f" (UID: "feeac35a-030c-4464-9c93-43b9203ad78f"). InnerVolumeSpecName "kube-api-access-2gddk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:40.824430 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.824410 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util" (OuterVolumeSpecName: "util") pod "feeac35a-030c-4464-9c93-43b9203ad78f" (UID: "feeac35a-030c-4464-9c93-43b9203ad78f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:40.921168 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.921101 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:40.921168 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.921125 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2gddk\" (UniqueName: \"kubernetes.io/projected/feeac35a-030c-4464-9c93-43b9203ad78f-kube-api-access-2gddk\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:40.921168 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:40.921136 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/feeac35a-030c-4464-9c93-43b9203ad78f-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:41.629963 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:41.629926 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" event={"ID":"feeac35a-030c-4464-9c93-43b9203ad78f","Type":"ContainerDied","Data":"816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6"} Jul 02 19:59:41.629963 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:41.629952 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fmpgn7" Jul 02 19:59:41.629963 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:41.629972 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="816bd0a3938d4f9ea7ace1cbc5999017b438106758ff6167e088c6e8906acee6" Jul 02 19:59:43.615484 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:43.615455 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-tmrxs" Jul 02 19:59:46.616832 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.616789 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c745959f-bjjjv" podUID="1bcbc225-7cbc-4425-8e1a-c870d5310540" containerName="console" containerID="cri-o://778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02" gracePeriod=15 Jul 02 19:59:46.857664 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.857640 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:59:46.969989 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.969923 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.969989 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.969957 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.969990 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970102 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970132 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970164 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlltk\" (UniqueName: \"kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970199 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970191 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca\") pod \"1bcbc225-7cbc-4425-8e1a-c870d5310540\" (UID: \"1bcbc225-7cbc-4425-8e1a-c870d5310540\") " Jul 02 19:59:46.970496 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970451 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:46.970496 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970442 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:46.970496 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970492 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config" (OuterVolumeSpecName: "console-config") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:46.970735 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.970690 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca" (OuterVolumeSpecName: "service-ca") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 19:59:46.972170 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.972143 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:46.972257 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.972178 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 19:59:46.972257 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:46.972189 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk" (OuterVolumeSpecName: "kube-api-access-vlltk") pod "1bcbc225-7cbc-4425-8e1a-c870d5310540" (UID: "1bcbc225-7cbc-4425-8e1a-c870d5310540"). InnerVolumeSpecName "kube-api-access-vlltk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:47.070853 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070827 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-oauth-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.070853 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070849 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.071006 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070860 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1bcbc225-7cbc-4425-8e1a-c870d5310540-console-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.071006 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070868 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlltk\" (UniqueName: \"kubernetes.io/projected/1bcbc225-7cbc-4425-8e1a-c870d5310540-kube-api-access-vlltk\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.071006 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070896 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-service-ca\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.071006 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070904 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-trusted-ca-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.071006 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.070912 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1bcbc225-7cbc-4425-8e1a-c870d5310540-oauth-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:47.657555 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.657514 2568 generic.go:356] "Generic (PLEG): container finished" podID="1bcbc225-7cbc-4425-8e1a-c870d5310540" containerID="778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02" exitCode=0 Jul 02 19:59:47.658005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.657562 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c745959f-bjjjv" Jul 02 19:59:47.658005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.657572 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c745959f-bjjjv" event={"ID":"1bcbc225-7cbc-4425-8e1a-c870d5310540","Type":"ContainerDied","Data":"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02"} Jul 02 19:59:47.658005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.657621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c745959f-bjjjv" event={"ID":"1bcbc225-7cbc-4425-8e1a-c870d5310540","Type":"ContainerDied","Data":"0f33c3df65e3b7cece5f95c52905deb5349642b39e0b45c24f69ec2d11db60b4"} Jul 02 19:59:47.658005 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.657649 2568 scope.go:117] "RemoveContainer" containerID="778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02" Jul 02 19:59:47.666428 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.666399 2568 scope.go:117] "RemoveContainer" containerID="778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02" Jul 02 19:59:47.666698 ip-10-0-139-102 kubenswrapper[2568]: E0702 19:59:47.666678 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02\": container with ID starting with 778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02 not found: ID does not exist" containerID="778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02" Jul 02 19:59:47.666750 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.666704 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02"} err="failed to get container status \"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02\": rpc error: code = NotFound desc = could not find container \"778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02\": container with ID starting with 778fb5885d80040b25d7170ee4c598784f5e3204ba71b4d33a47b9021bc10c02 not found: ID does not exist" Jul 02 19:59:47.679701 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.679678 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:59:47.688046 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:47.688025 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c745959f-bjjjv"] Jul 02 19:59:48.396996 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:48.396965 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1bcbc225-7cbc-4425-8e1a-c870d5310540" path="/var/lib/kubelet/pods/1bcbc225-7cbc-4425-8e1a-c870d5310540/volumes" Jul 02 19:59:50.292729 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.292702 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 19:59:50.299554 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.299528 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 19:59:50.303206 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.303187 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 02 19:59:50.901197 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901162 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5"] Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901441 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="util" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901453 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="util" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901462 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1bcbc225-7cbc-4425-8e1a-c870d5310540" containerName="console" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901469 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1bcbc225-7cbc-4425-8e1a-c870d5310540" containerName="console" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901480 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="pull" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901485 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="pull" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901498 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="extract" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901503 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="extract" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901568 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1bcbc225-7cbc-4425-8e1a-c870d5310540" containerName="console" Jul 02 19:59:50.902150 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.901577 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="feeac35a-030c-4464-9c93-43b9203ad78f" containerName="extract" Jul 02 19:59:50.903214 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.903198 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:50.905922 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.905899 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-6shcc\"" Jul 02 19:59:50.906046 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.905944 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 02 19:59:50.906046 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.905947 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 02 19:59:50.915837 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:50.915754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5"] Jul 02 19:59:51.002951 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.002921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.003127 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.002973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.003127 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.003024 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2cfr\" (UniqueName: \"kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.104422 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.104384 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2cfr\" (UniqueName: \"kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.104697 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.104676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.104847 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.104831 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.105394 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.105368 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.106143 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.106122 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.114623 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.114602 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2cfr\" (UniqueName: \"kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.236850 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.236771 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:51.357296 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.357263 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5"] Jul 02 19:59:51.359055 ip-10-0-139-102 kubenswrapper[2568]: W0702 19:59:51.359025 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e79885f_21b9_4bc7_bd89_9cb3d6857d1b.slice/crio-cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c WatchSource:0}: Error finding container cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c: Status 404 returned error can't find the container with id cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c Jul 02 19:59:51.676217 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.676181 2568 generic.go:356] "Generic (PLEG): container finished" podID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerID="9632403e8770dcf77400364f74751ba6a5f55d16db6ecc8b0228fac4390ea48a" exitCode=0 Jul 02 19:59:51.676404 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.676242 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" event={"ID":"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b","Type":"ContainerDied","Data":"9632403e8770dcf77400364f74751ba6a5f55d16db6ecc8b0228fac4390ea48a"} Jul 02 19:59:51.676404 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.676283 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" event={"ID":"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b","Type":"ContainerStarted","Data":"cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c"} Jul 02 19:59:51.676769 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:51.676749 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 19:59:52.682193 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:52.682164 2568 generic.go:356] "Generic (PLEG): container finished" podID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerID="5bd25b1d74b74f1adfbfb645b83fd2586d2067a6421cd009943efda66f89f95e" exitCode=0 Jul 02 19:59:52.682555 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:52.682244 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" event={"ID":"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b","Type":"ContainerDied","Data":"5bd25b1d74b74f1adfbfb645b83fd2586d2067a6421cd009943efda66f89f95e"} Jul 02 19:59:53.688252 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:53.688220 2568 generic.go:356] "Generic (PLEG): container finished" podID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerID="2354f92116fab2f53d4d9bdc50a8f02987b9d60f2df5582ccc4e3317fcb26372" exitCode=0 Jul 02 19:59:53.688625 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:53.688290 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" event={"ID":"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b","Type":"ContainerDied","Data":"2354f92116fab2f53d4d9bdc50a8f02987b9d60f2df5582ccc4e3317fcb26372"} Jul 02 19:59:54.817367 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.817345 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 19:59:54.937125 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.937101 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util\") pod \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " Jul 02 19:59:54.937259 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.937148 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2cfr\" (UniqueName: \"kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr\") pod \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " Jul 02 19:59:54.937259 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.937181 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle\") pod \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\" (UID: \"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b\") " Jul 02 19:59:54.937862 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.937836 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle" (OuterVolumeSpecName: "bundle") pod "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" (UID: "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:54.939225 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.939192 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr" (OuterVolumeSpecName: "kube-api-access-b2cfr") pod "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" (UID: "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b"). InnerVolumeSpecName "kube-api-access-b2cfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 19:59:54.943010 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:54.942956 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util" (OuterVolumeSpecName: "util") pod "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" (UID: "1e79885f-21b9-4bc7-bd89-9cb3d6857d1b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 19:59:55.037703 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.037676 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:55.037703 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.037697 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2cfr\" (UniqueName: \"kubernetes.io/projected/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-kube-api-access-b2cfr\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:55.037703 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.037707 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e79885f-21b9-4bc7-bd89-9cb3d6857d1b-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 19:59:55.698494 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.698460 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" event={"ID":"1e79885f-21b9-4bc7-bd89-9cb3d6857d1b","Type":"ContainerDied","Data":"cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c"} Jul 02 19:59:55.698665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.698507 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cf14bce8656332d06ce3ab82d377f60d021b341c694e5f89e334d4fe938f868c" Jul 02 19:59:55.698665 ip-10-0-139-102 kubenswrapper[2568]: I0702 19:59:55.698506 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afjf5g5" Jul 02 20:00:03.600645 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600609 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk"] Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600948 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="pull" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600961 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="pull" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600977 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="extract" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600982 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="extract" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.600996 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="util" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.601001 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="util" Jul 02 20:00:03.601110 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.601051 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e79885f-21b9-4bc7-bd89-9cb3d6857d1b" containerName="extract" Jul 02 20:00:03.605276 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.605257 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.608624 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.608601 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 02 20:00:03.608800 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.608786 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 02 20:00:03.609064 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.609042 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 02 20:00:03.609123 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.609102 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 02 20:00:03.609443 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.609426 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-928ls\"" Jul 02 20:00:03.631265 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.631246 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk"] Jul 02 20:00:03.703087 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.703054 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-tmp\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.703233 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.703098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-manifests\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.703233 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.703173 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.703314 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.703254 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6h74\" (UniqueName: \"kubernetes.io/projected/7aeca63a-3440-4c14-addb-070ca8fa8d20-kube-api-access-q6h74\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.703314 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.703297 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804114 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804091 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-tmp\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804247 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804122 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-manifests\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804247 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804147 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804247 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6h74\" (UniqueName: \"kubernetes.io/projected/7aeca63a-3440-4c14-addb-070ca8fa8d20-kube-api-access-q6h74\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804247 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804238 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.804596 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.804574 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-manifests\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.806538 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.806512 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7aeca63a-3440-4c14-addb-070ca8fa8d20-tmp\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.806641 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.806586 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-webhook-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.806687 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.806637 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7aeca63a-3440-4c14-addb-070ca8fa8d20-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.812601 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.812583 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6h74\" (UniqueName: \"kubernetes.io/projected/7aeca63a-3440-4c14-addb-070ca8fa8d20-kube-api-access-q6h74\") pod \"opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk\" (UID: \"7aeca63a-3440-4c14-addb-070ca8fa8d20\") " pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:03.915897 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:03.915853 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:04.051777 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:04.051754 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk"] Jul 02 20:00:04.054499 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:04.054473 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7aeca63a_3440_4c14_addb_070ca8fa8d20.slice/crio-fdd243c55c3b58083502b1d11f43ccf82c9ba9a143a6052d1aa1fffb91711179 WatchSource:0}: Error finding container fdd243c55c3b58083502b1d11f43ccf82c9ba9a143a6052d1aa1fffb91711179: Status 404 returned error can't find the container with id fdd243c55c3b58083502b1d11f43ccf82c9ba9a143a6052d1aa1fffb91711179 Jul 02 20:00:04.738943 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:04.738905 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" event={"ID":"7aeca63a-3440-4c14-addb-070ca8fa8d20","Type":"ContainerStarted","Data":"fdd243c55c3b58083502b1d11f43ccf82c9ba9a143a6052d1aa1fffb91711179"} Jul 02 20:00:08.763587 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:08.763552 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" event={"ID":"7aeca63a-3440-4c14-addb-070ca8fa8d20","Type":"ContainerStarted","Data":"5bf28861930e8714651d56462b605ed64bd0148e859fa9d87a6c3df347f66800"} Jul 02 20:00:09.769824 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:09.769791 2568 generic.go:356] "Generic (PLEG): container finished" podID="7aeca63a-3440-4c14-addb-070ca8fa8d20" containerID="5bf28861930e8714651d56462b605ed64bd0148e859fa9d87a6c3df347f66800" exitCode=0 Jul 02 20:00:09.770214 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:09.769887 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" event={"ID":"7aeca63a-3440-4c14-addb-070ca8fa8d20","Type":"ContainerDied","Data":"5bf28861930e8714651d56462b605ed64bd0148e859fa9d87a6c3df347f66800"} Jul 02 20:00:10.776308 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:10.776231 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" event={"ID":"7aeca63a-3440-4c14-addb-070ca8fa8d20","Type":"ContainerStarted","Data":"232c18a224e5a7160921fc31b011cec9ac833979e0c03fd8e93576c14a5e9f24"} Jul 02 20:00:10.776666 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:10.776361 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:10.799754 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:10.799702 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" podStartSLOduration=2.251820151 podStartE2EDuration="7.799688095s" totalImagesPullingTime="4.450712879s" totalInitContainerRuntime="1.097155065s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:03 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:10.798425056 +0000 UTC m=+320.902576149" watchObservedRunningTime="2026-07-02 20:00:10.799688095 +0000 UTC m=+320.903839187" Jul 02 20:00:21.783037 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:21.783005 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk" Jul 02 20:00:24.136773 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.136734 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-847997768d-8xk6b"] Jul 02 20:00:24.143776 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.143747 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.150633 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.150608 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 02 20:00:24.151071 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.151054 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 02 20:00:24.151768 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.151754 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 02 20:00:24.152005 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.151983 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 02 20:00:24.152156 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.152043 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 02 20:00:24.152156 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.151987 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k8sh5\"" Jul 02 20:00:24.157450 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.157429 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.157539 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.157467 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vz9xt\" (UniqueName: \"kubernetes.io/projected/7b27f789-6a17-42d9-a358-6797660aec4f-kube-api-access-vz9xt\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.157539 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.157511 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b27f789-6a17-42d9-a358-6797660aec4f-manager-config\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.157539 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.157528 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-metrics-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.163716 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.163695 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-847997768d-8xk6b"] Jul 02 20:00:24.258134 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.258101 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b27f789-6a17-42d9-a358-6797660aec4f-manager-config\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.258134 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.258134 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-metrics-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.258344 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.258168 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.258344 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.258213 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vz9xt\" (UniqueName: \"kubernetes.io/projected/7b27f789-6a17-42d9-a358-6797660aec4f-kube-api-access-vz9xt\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.258863 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.258836 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/7b27f789-6a17-42d9-a358-6797660aec4f-manager-config\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.260762 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.260735 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-metrics-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.260907 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.260786 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/7b27f789-6a17-42d9-a358-6797660aec4f-cert\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.269215 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.269191 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vz9xt\" (UniqueName: \"kubernetes.io/projected/7b27f789-6a17-42d9-a358-6797660aec4f-kube-api-access-vz9xt\") pod \"lws-controller-manager-847997768d-8xk6b\" (UID: \"7b27f789-6a17-42d9-a358-6797660aec4f\") " pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.452972 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.452856 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:24.590332 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.590306 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-847997768d-8xk6b"] Jul 02 20:00:24.592735 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:24.592709 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b27f789_6a17_42d9_a358_6797660aec4f.slice/crio-2863573b3f9f38e465016b9778dadc87ff15db5b32dd5f5318ae58587a32e566 WatchSource:0}: Error finding container 2863573b3f9f38e465016b9778dadc87ff15db5b32dd5f5318ae58587a32e566: Status 404 returned error can't find the container with id 2863573b3f9f38e465016b9778dadc87ff15db5b32dd5f5318ae58587a32e566 Jul 02 20:00:24.834269 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:24.834183 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" event={"ID":"7b27f789-6a17-42d9-a358-6797660aec4f","Type":"ContainerStarted","Data":"2863573b3f9f38e465016b9778dadc87ff15db5b32dd5f5318ae58587a32e566"} Jul 02 20:00:25.708722 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.708691 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lk762"] Jul 02 20:00:25.713074 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.713055 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:25.716195 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.716175 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 02 20:00:25.723391 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.723367 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lk762"] Jul 02 20:00:25.772692 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.772653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-78l5l\" (UniqueName: \"kubernetes.io/projected/c5935b9a-46e2-4df2-8621-df7fe1860d50-kube-api-access-78l5l\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:25.772867 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.772717 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:25.873496 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.873456 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-78l5l\" (UniqueName: \"kubernetes.io/projected/c5935b9a-46e2-4df2-8621-df7fe1860d50-kube-api-access-78l5l\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:25.873671 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.873521 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:25.873671 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:25.873611 2568 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 02 20:00:25.873671 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:25.873663 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs podName:c5935b9a-46e2-4df2-8621-df7fe1860d50 nodeName:}" failed. No retries permitted until 2026-07-02 20:00:26.373648646 +0000 UTC m=+336.477799722 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs") pod "model-serving-api-54d89bd5fc-lk762" (UID: "c5935b9a-46e2-4df2-8621-df7fe1860d50") : secret "model-serving-api-tls" not found Jul 02 20:00:25.882428 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:25.882398 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-78l5l\" (UniqueName: \"kubernetes.io/projected/c5935b9a-46e2-4df2-8621-df7fe1860d50-kube-api-access-78l5l\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:26.377396 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:26.377352 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:26.379741 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:26.379717 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5935b9a-46e2-4df2-8621-df7fe1860d50-tls-certs\") pod \"model-serving-api-54d89bd5fc-lk762\" (UID: \"c5935b9a-46e2-4df2-8621-df7fe1860d50\") " pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:26.624263 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:26.624227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:26.749551 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:26.749522 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-lk762"] Jul 02 20:00:26.751271 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:26.751245 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc5935b9a_46e2_4df2_8621_df7fe1860d50.slice/crio-9af2d362bfe7a7cb9dd4a7d37f67790382d6970383f5124c4c1f5b87ba68e7a9 WatchSource:0}: Error finding container 9af2d362bfe7a7cb9dd4a7d37f67790382d6970383f5124c4c1f5b87ba68e7a9: Status 404 returned error can't find the container with id 9af2d362bfe7a7cb9dd4a7d37f67790382d6970383f5124c4c1f5b87ba68e7a9 Jul 02 20:00:26.846807 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:26.846756 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" event={"ID":"c5935b9a-46e2-4df2-8621-df7fe1860d50","Type":"ContainerStarted","Data":"9af2d362bfe7a7cb9dd4a7d37f67790382d6970383f5124c4c1f5b87ba68e7a9"} Jul 02 20:00:28.858146 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:28.858050 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" event={"ID":"c5935b9a-46e2-4df2-8621-df7fe1860d50","Type":"ContainerStarted","Data":"622257faee158f54b61c43c87a96bb8c57a5f59c2a849d38ac3280918813d439"} Jul 02 20:00:28.858146 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:28.858133 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:28.876486 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:28.876438 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" podStartSLOduration=2.103374901 podStartE2EDuration="3.876424275s" totalImagesPullingTime="1.773049374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:28.875084003 +0000 UTC m=+338.979235094" watchObservedRunningTime="2026-07-02 20:00:28.876424275 +0000 UTC m=+338.980575368" Jul 02 20:00:31.819692 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.819654 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:31.823351 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.823330 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.828056 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.828037 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 02 20:00:31.828340 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.828323 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-s6t5c\"" Jul 02 20:00:31.839739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.839716 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:31.921841 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtr6f\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.921841 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921892 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921920 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.921969 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.922029 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.922076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.922103 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.922094 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:31.953524 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.953492 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw"] Jul 02 20:00:31.956186 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.956171 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:31.969708 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:31.969682 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw"] Jul 02 20:00:32.022610 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022577 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.022724 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022613 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.022724 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.022724 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022675 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.022724 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022717 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022749 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022780 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022819 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022872 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.022959 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.022979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023013 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023066 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023124 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023179 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zls5w\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-kube-api-access-zls5w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023224 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtr6f\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023259 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023253 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023751 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023455 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.023751 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.023607 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.025094 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.025062 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.025750 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.025726 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.034000 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.033958 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.034153 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.034064 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtr6f\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f\") pod \"data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.124292 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124261 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124303 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124341 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zls5w\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-kube-api-access-zls5w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124422 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124446 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124483 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124579 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124863 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124768 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.124941 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.124858 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.125298 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.125126 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.125400 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.125381 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.125445 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.125411 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.126716 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.126693 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.127457 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.127440 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.134477 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.134456 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:32.134648 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.134618 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.135223 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.135205 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zls5w\" (UniqueName: \"kubernetes.io/projected/a3cd4fbd-308b-4068-bcfc-5f7f72322486-kube-api-access-zls5w\") pod \"data-science-gateway-data-science-gateway-class-6576859cf455frw\" (UID: \"a3cd4fbd-308b-4068-bcfc-5f7f72322486\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.265726 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.265693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:32.271634 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.271607 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:32.276738 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:32.276708 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc289e159_4558_4407_8f10_ffc6c470179f.slice/crio-c4ab7562fac3322cad208cd6ddf77b147ea45a9b0e7ca8121004c781a0f0455d WatchSource:0}: Error finding container c4ab7562fac3322cad208cd6ddf77b147ea45a9b0e7ca8121004c781a0f0455d: Status 404 returned error can't find the container with id c4ab7562fac3322cad208cd6ddf77b147ea45a9b0e7ca8121004c781a0f0455d Jul 02 20:00:32.416293 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.416255 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw"] Jul 02 20:00:32.416666 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:32.416630 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3cd4fbd_308b_4068_bcfc_5f7f72322486.slice/crio-0f111b270abecb11026025303ab25d6b601cb60f4d3ff1d09ddaa931cb161d17 WatchSource:0}: Error finding container 0f111b270abecb11026025303ab25d6b601cb60f4d3ff1d09ddaa931cb161d17: Status 404 returned error can't find the container with id 0f111b270abecb11026025303ab25d6b601cb60f4d3ff1d09ddaa931cb161d17 Jul 02 20:00:32.878551 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.878505 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" event={"ID":"c289e159-4558-4407-8f10-ffc6c470179f","Type":"ContainerStarted","Data":"c4ab7562fac3322cad208cd6ddf77b147ea45a9b0e7ca8121004c781a0f0455d"} Jul 02 20:00:32.880140 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.880114 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" event={"ID":"7b27f789-6a17-42d9-a358-6797660aec4f","Type":"ContainerStarted","Data":"3ecbcccdb8e595fabaa02825163fc62e82d11e1d8c7110d4d6f481e0017ec39d"} Jul 02 20:00:32.880276 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.880202 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:32.881501 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.881468 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" event={"ID":"a3cd4fbd-308b-4068-bcfc-5f7f72322486","Type":"ContainerStarted","Data":"0f111b270abecb11026025303ab25d6b601cb60f4d3ff1d09ddaa931cb161d17"} Jul 02 20:00:32.929287 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:32.929208 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" podStartSLOduration=1.539995711 podStartE2EDuration="8.929188629s" totalImagesPullingTime="7.389192918s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:32.926372739 +0000 UTC m=+343.030523844" watchObservedRunningTime="2026-07-02 20:00:32.929188629 +0000 UTC m=+343.033339721" Jul 02 20:00:35.234090 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.234052 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.234481 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.234138 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.234481 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.234187 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.239702 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.239676 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.239777 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.239730 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.239777 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.239756 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:00:35.898219 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.898184 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" event={"ID":"c289e159-4558-4407-8f10-ffc6c470179f","Type":"ContainerStarted","Data":"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b"} Jul 02 20:00:35.905934 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.905900 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" event={"ID":"a3cd4fbd-308b-4068-bcfc-5f7f72322486","Type":"ContainerStarted","Data":"7fb5310e7c3bfa24858c623960ad9c45fbbf7c2b200eb076bb29e39707dd3d7d"} Jul 02 20:00:35.950062 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:35.950011 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" podStartSLOduration=1.994798144 podStartE2EDuration="4.949997061s" totalImagesPullingTime="2.955198917s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:35.949654294 +0000 UTC m=+346.053805388" watchObservedRunningTime="2026-07-02 20:00:35.949997061 +0000 UTC m=+346.054148153" Jul 02 20:00:36.017717 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.017664 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" podStartSLOduration=2.196733852 podStartE2EDuration="5.017648583s" totalImagesPullingTime="2.820914731s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:36.016062173 +0000 UTC m=+346.120213267" watchObservedRunningTime="2026-07-02 20:00:36.017648583 +0000 UTC m=+346.121799676" Jul 02 20:00:36.018784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.018760 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r"] Jul 02 20:00:36.022136 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.022119 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp"] Jul 02 20:00:36.022270 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.022254 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.025470 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.025454 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.025777 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.025752 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-controller-manager-dockercfg-hb22r\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hb22r\"" type="*v1.Secret" Jul 02 20:00:36.026051 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.026033 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"llmisvc-webhook-server-cert\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" type="*v1.Secret" Jul 02 20:00:36.026302 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.026282 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"llmisvc-controller-manager-777c6bd7d5-74z4r\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="44265589-e81b-4289-a5fa-c59f543cb685" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.028589 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.028569 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-hvlrb\"" Jul 02 20:00:36.028693 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.028571 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 02 20:00:36.057035 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.057006 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp"] Jul 02 20:00:36.059159 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.059134 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r"] Jul 02 20:00:36.061826 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.061804 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94qtj\" (UniqueName: \"kubernetes.io/projected/df2768fa-619b-42a9-aff9-dddb63f445cc-kube-api-access-94qtj\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.061923 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.061833 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2zf6\" (UniqueName: \"kubernetes.io/projected/44265589-e81b-4289-a5fa-c59f543cb685-kube-api-access-v2zf6\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.061923 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.061916 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.062009 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.061961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.135552 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.135518 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:36.136809 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.136784 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 02 20:00:36.136940 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.136840 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 02 20:00:36.162918 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.162842 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94qtj\" (UniqueName: \"kubernetes.io/projected/df2768fa-619b-42a9-aff9-dddb63f445cc-kube-api-access-94qtj\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.162918 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.162891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2zf6\" (UniqueName: \"kubernetes.io/projected/44265589-e81b-4289-a5fa-c59f543cb685-kube-api-access-v2zf6\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.163026 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.162928 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.163026 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.162960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.163095 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.163067 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 20:00:36.163150 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.163138 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert podName:df2768fa-619b-42a9-aff9-dddb63f445cc nodeName:}" failed. No retries permitted until 2026-07-02 20:00:36.66311869 +0000 UTC m=+346.767269769 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert") pod "kserve-controller-manager-d6f4b65b8-nt8hp" (UID: "df2768fa-619b-42a9-aff9-dddb63f445cc") : secret "kserve-webhook-server-cert" not found Jul 02 20:00:36.171586 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.171562 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2zf6\" (UniqueName: \"kubernetes.io/projected/44265589-e81b-4289-a5fa-c59f543cb685-kube-api-access-v2zf6\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:36.172112 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.172091 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94qtj\" (UniqueName: \"kubernetes.io/projected/df2768fa-619b-42a9-aff9-dddb63f445cc-kube-api-access-94qtj\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.266890 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.266843 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:36.271221 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.271198 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:36.667580 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.667547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:36.667750 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.667667 2568 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 02 20:00:36.667750 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:36.667716 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert podName:df2768fa-619b-42a9-aff9-dddb63f445cc nodeName:}" failed. No retries permitted until 2026-07-02 20:00:37.667701148 +0000 UTC m=+347.771852223 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert") pod "kserve-controller-manager-d6f4b65b8-nt8hp" (UID: "df2768fa-619b-42a9-aff9-dddb63f445cc") : secret "kserve-webhook-server-cert" not found Jul 02 20:00:36.910476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.910434 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:36.911241 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.911224 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf455frw" Jul 02 20:00:36.970686 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:36.970607 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:37.135236 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.135199 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 02 20:00:37.135372 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.135262 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 02 20:00:37.163668 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:37.163637 2568 secret.go:189] Couldn't get secret opendatahub/llmisvc-webhook-server-cert: failed to sync secret cache: timed out waiting for the condition Jul 02 20:00:37.163790 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:37.163726 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert podName:44265589-e81b-4289-a5fa-c59f543cb685 nodeName:}" failed. No retries permitted until 2026-07-02 20:00:37.663704682 +0000 UTC m=+347.767855775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert") pod "llmisvc-controller-manager-777c6bd7d5-74z4r" (UID: "44265589-e81b-4289-a5fa-c59f543cb685") : failed to sync secret cache: timed out waiting for the condition Jul 02 20:00:37.466791 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.466763 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-hb22r\"" Jul 02 20:00:37.501060 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.501031 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 02 20:00:37.678082 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.678051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:37.678257 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.678095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:37.680415 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.680387 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/44265589-e81b-4289-a5fa-c59f543cb685-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-74z4r\" (UID: \"44265589-e81b-4289-a5fa-c59f543cb685\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:37.680519 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.680443 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/df2768fa-619b-42a9-aff9-dddb63f445cc-cert\") pod \"kserve-controller-manager-d6f4b65b8-nt8hp\" (UID: \"df2768fa-619b-42a9-aff9-dddb63f445cc\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:37.833814 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.833751 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:37.839913 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.839885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:37.996366 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:37.996333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r"] Jul 02 20:00:37.997798 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:37.997759 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod44265589_e81b_4289_a5fa_c59f543cb685.slice/crio-94c38f5efacc943c89d0fbc46245f99f8eb7988830189ce380816257dd5f688f WatchSource:0}: Error finding container 94c38f5efacc943c89d0fbc46245f99f8eb7988830189ce380816257dd5f688f: Status 404 returned error can't find the container with id 94c38f5efacc943c89d0fbc46245f99f8eb7988830189ce380816257dd5f688f Jul 02 20:00:38.024286 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.024264 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp"] Jul 02 20:00:38.025119 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:00:38.025093 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf2768fa_619b_42a9_aff9_dddb63f445cc.slice/crio-0877517df60f80d37632d722d73fdb2d67dd817dbb5992d3fa71328b46081288 WatchSource:0}: Error finding container 0877517df60f80d37632d722d73fdb2d67dd817dbb5992d3fa71328b46081288: Status 404 returned error can't find the container with id 0877517df60f80d37632d722d73fdb2d67dd817dbb5992d3fa71328b46081288 Jul 02 20:00:38.135190 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.135165 2568 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 02 20:00:38.135334 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.135216 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 02 20:00:38.927130 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.926917 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" event={"ID":"df2768fa-619b-42a9-aff9-dddb63f445cc","Type":"ContainerStarted","Data":"0877517df60f80d37632d722d73fdb2d67dd817dbb5992d3fa71328b46081288"} Jul 02 20:00:38.928660 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.928624 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" containerID="cri-o://ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b" gracePeriod=30 Jul 02 20:00:38.928838 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:38.928816 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" event={"ID":"44265589-e81b-4289-a5fa-c59f543cb685","Type":"ContainerStarted","Data":"94c38f5efacc943c89d0fbc46245f99f8eb7988830189ce380816257dd5f688f"} Jul 02 20:00:39.867117 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:39.867088 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-lk762" Jul 02 20:00:41.946190 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.946157 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" event={"ID":"44265589-e81b-4289-a5fa-c59f543cb685","Type":"ContainerStarted","Data":"95037b8d93ef762f64defc2908132961880562bbba2b01f248fa678019cf3abd"} Jul 02 20:00:41.946624 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.946278 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:00:41.947675 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.947655 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" event={"ID":"df2768fa-619b-42a9-aff9-dddb63f445cc","Type":"ContainerStarted","Data":"4c6ea43d29e7029da576bc5db91afa24f081577a689a7b3d1af360ffcfa002d1"} Jul 02 20:00:41.947799 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.947786 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:00:41.962929 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.962855 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" podStartSLOduration=3.69396815 podStartE2EDuration="6.962843356s" totalImagesPullingTime="3.268875206s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:41.962453501 +0000 UTC m=+352.066604625" watchObservedRunningTime="2026-07-02 20:00:41.962843356 +0000 UTC m=+352.066994449" Jul 02 20:00:41.982408 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:41.982366 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" podStartSLOduration=3.744237504 podStartE2EDuration="6.982352865s" totalImagesPullingTime="3.238115361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:00:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:00:41.981487494 +0000 UTC m=+352.085638593" watchObservedRunningTime="2026-07-02 20:00:41.982352865 +0000 UTC m=+352.086503957" Jul 02 20:00:43.890204 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:43.890172 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-847997768d-8xk6b" Jul 02 20:00:44.194060 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.194034 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:44.244080 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244038 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244080 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244076 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244096 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244135 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244159 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244208 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jtr6f\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244234 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244269 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244316 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket\") pod \"c289e159-4558-4407-8f10-ffc6c470179f\" (UID: \"c289e159-4558-4407-8f10-ffc6c470179f\") " Jul 02 20:00:44.244658 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244378 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:44.244658 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244563 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:44.244658 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244600 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:00:44.244817 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244673 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-socket\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.244817 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244763 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:44.244817 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.244693 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-workload-certs\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.245077 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.245054 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data" (OuterVolumeSpecName: "istio-data") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:44.246508 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.246481 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:00:44.246735 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.246712 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token" (OuterVolumeSpecName: "istio-token") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:44.246817 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.246774 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 02 20:00:44.246864 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.246831 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f" (OuterVolumeSpecName: "kube-api-access-jtr6f") pod "c289e159-4558-4407-8f10-ffc6c470179f" (UID: "c289e159-4558-4407-8f10-ffc6c470179f"). InnerVolumeSpecName "kube-api-access-jtr6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:00:44.345684 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345643 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jtr6f\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-kube-api-access-jtr6f\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345684 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345678 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c289e159-4558-4407-8f10-ffc6c470179f-istio-podinfo\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345684 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345687 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-credential-socket\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345684 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345696 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-envoy\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345964 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345705 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c289e159-4558-4407-8f10-ffc6c470179f-istio-token\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345964 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345712 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c289e159-4558-4407-8f10-ffc6c470179f-istio-data\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.345964 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.345719 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c289e159-4558-4407-8f10-ffc6c470179f-istiod-ca-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:00:44.963812 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.963778 2568 generic.go:356] "Generic (PLEG): container finished" podID="c289e159-4558-4407-8f10-ffc6c470179f" containerID="ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b" exitCode=0 Jul 02 20:00:44.963812 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.963814 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" event={"ID":"c289e159-4558-4407-8f10-ffc6c470179f","Type":"ContainerDied","Data":"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b"} Jul 02 20:00:44.964265 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.963824 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" Jul 02 20:00:44.964265 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.963851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk" event={"ID":"c289e159-4558-4407-8f10-ffc6c470179f","Type":"ContainerDied","Data":"c4ab7562fac3322cad208cd6ddf77b147ea45a9b0e7ca8121004c781a0f0455d"} Jul 02 20:00:44.964265 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.963889 2568 scope.go:117] "RemoveContainer" containerID="ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b" Jul 02 20:00:44.972565 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.972549 2568 scope.go:117] "RemoveContainer" containerID="ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b" Jul 02 20:00:44.972868 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:00:44.972848 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b\": container with ID starting with ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b not found: ID does not exist" containerID="ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b" Jul 02 20:00:44.972944 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.972894 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b"} err="failed to get container status \"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b\": rpc error: code = NotFound desc = could not find container \"ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b\": container with ID starting with ec13d8111e3195c737f3f8aad65f1d35c80f728564ad1b8c4793e63beffe004b not found: ID does not exist" Jul 02 20:00:44.983806 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.983786 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:44.988979 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:44.988961 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-84cc848bd-zhcgk"] Jul 02 20:00:46.397615 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:00:46.397582 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c289e159-4558-4407-8f10-ffc6c470179f" path="/var/lib/kubelet/pods/c289e159-4558-4407-8f10-ffc6c470179f/volumes" Jul 02 20:01:12.956551 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:12.956516 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-74z4r" Jul 02 20:01:12.959484 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:12.959464 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-nt8hp" Jul 02 20:01:41.161611 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.161573 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5"] Jul 02 20:01:41.162818 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.162792 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" Jul 02 20:01:41.162993 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.162980 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" Jul 02 20:01:41.163253 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.163239 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="c289e159-4558-4407-8f10-ffc6c470179f" containerName="istio-proxy" Jul 02 20:01:41.166481 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.166459 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.169327 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.169306 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:01:41.169431 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.169371 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dzpvl\"" Jul 02 20:01:41.170527 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.170512 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:01:41.174432 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.174414 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5"] Jul 02 20:01:41.309625 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.309597 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.309784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.309648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.309784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.309713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sx8pc\" (UniqueName: \"kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.410986 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.410944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sx8pc\" (UniqueName: \"kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.411162 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.411004 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.411162 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.411060 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.411433 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.411411 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.411498 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.411421 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.419318 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.419274 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sx8pc\" (UniqueName: \"kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.477228 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.477190 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:41.604355 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.604333 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5"] Jul 02 20:01:41.606175 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:01:41.606149 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod62e7f3f7_5ffa_49e1_b8af_b17a074d3103.slice/crio-b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec WatchSource:0}: Error finding container b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec: Status 404 returned error can't find the container with id b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec Jul 02 20:01:41.884521 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.884488 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr"] Jul 02 20:01:41.887378 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.887360 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:41.895331 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:41.895307 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr"] Jul 02 20:01:42.016585 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.016510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5s86t\" (UniqueName: \"kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.016585 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.016546 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.016585 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.016573 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.117747 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.117714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5s86t\" (UniqueName: \"kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.117942 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.117755 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.117942 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.117779 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.118121 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.118101 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.118171 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.118131 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.126868 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.126850 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5s86t\" (UniqueName: \"kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.197540 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.197514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:42.230202 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.230173 2568 generic.go:356] "Generic (PLEG): container finished" podID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerID="3d759129173ced716a5529683d17f0bfa31b8bd0e8129152953ce9b5bffdc038" exitCode=0 Jul 02 20:01:42.230365 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.230253 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" event={"ID":"62e7f3f7-5ffa-49e1-b8af-b17a074d3103","Type":"ContainerDied","Data":"3d759129173ced716a5529683d17f0bfa31b8bd0e8129152953ce9b5bffdc038"} Jul 02 20:01:42.230365 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.230309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" event={"ID":"62e7f3f7-5ffa-49e1-b8af-b17a074d3103","Type":"ContainerStarted","Data":"b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec"} Jul 02 20:01:42.341446 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.341422 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr"] Jul 02 20:01:42.343676 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:01:42.343651 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffce9970_8e64_4a0a_9442_466a1b76319e.slice/crio-ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972 WatchSource:0}: Error finding container ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972: Status 404 returned error can't find the container with id ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972 Jul 02 20:01:42.488580 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.488556 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np"] Jul 02 20:01:42.491104 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.491090 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.500133 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.500110 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np"] Jul 02 20:01:42.622081 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.622046 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.622248 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.622100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wxwmd\" (UniqueName: \"kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.622248 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.622170 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.722492 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.722464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.722651 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.722503 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wxwmd\" (UniqueName: \"kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.722651 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.722536 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.722829 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.722812 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.722943 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.722923 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.731393 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.731371 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wxwmd\" (UniqueName: \"kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.813141 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.813118 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:42.889230 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.889146 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg"] Jul 02 20:01:42.892927 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.892899 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:42.912559 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.912524 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg"] Jul 02 20:01:42.942847 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:42.942824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np"] Jul 02 20:01:42.944148 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:01:42.944123 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb43a72_5667_452e_b741_3f8fd2fecc5d.slice/crio-3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc WatchSource:0}: Error finding container 3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc: Status 404 returned error can't find the container with id 3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc Jul 02 20:01:43.025168 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.025139 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.025281 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.025177 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srwxp\" (UniqueName: \"kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.025281 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.025199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.126533 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.126502 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.126653 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.126541 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srwxp\" (UniqueName: \"kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.126653 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.126571 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.126992 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.126967 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.127066 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.126972 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.134926 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.134907 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-srwxp\" (UniqueName: \"kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.210914 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.210840 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:43.236487 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.236448 2568 generic.go:356] "Generic (PLEG): container finished" podID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerID="3df7ed10d385c9c29c4fff27b84ff8149556b69e133252523d33c40404d41c1f" exitCode=0 Jul 02 20:01:43.236602 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.236518 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerDied","Data":"3df7ed10d385c9c29c4fff27b84ff8149556b69e133252523d33c40404d41c1f"} Jul 02 20:01:43.236602 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.236587 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerStarted","Data":"3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc"} Jul 02 20:01:43.238289 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.238263 2568 generic.go:356] "Generic (PLEG): container finished" podID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerID="f321eff58afd277025462f8a95e9c987aaf9e19b51f59c4f69e61f92b6a0532d" exitCode=0 Jul 02 20:01:43.238390 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.238335 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" event={"ID":"ffce9970-8e64-4a0a-9442-466a1b76319e","Type":"ContainerDied","Data":"f321eff58afd277025462f8a95e9c987aaf9e19b51f59c4f69e61f92b6a0532d"} Jul 02 20:01:43.238451 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.238390 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" event={"ID":"ffce9970-8e64-4a0a-9442-466a1b76319e","Type":"ContainerStarted","Data":"ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972"} Jul 02 20:01:43.344069 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:43.344044 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg"] Jul 02 20:01:43.394162 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:01:43.394134 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29fec5ba_ccfd_459f_8d55_a2b8347b78eb.slice/crio-614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b WatchSource:0}: Error finding container 614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b: Status 404 returned error can't find the container with id 614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b Jul 02 20:01:44.247590 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.247561 2568 generic.go:356] "Generic (PLEG): container finished" podID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerID="0804e0e7ee422de5865ab8f7acabb5b71aed864ce54f29e12416fae55076c9c8" exitCode=0 Jul 02 20:01:44.247986 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.247636 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" event={"ID":"62e7f3f7-5ffa-49e1-b8af-b17a074d3103","Type":"ContainerDied","Data":"0804e0e7ee422de5865ab8f7acabb5b71aed864ce54f29e12416fae55076c9c8"} Jul 02 20:01:44.249531 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.249508 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerStarted","Data":"30b1b0474054caae89757b59ccaf8bb44f9948a0bb9373f63d9cf2b22d297bc6"} Jul 02 20:01:44.251316 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.251295 2568 generic.go:356] "Generic (PLEG): container finished" podID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerID="5b9f4468b4e92818aae0377cc198803483bf9996d0465314b0b543bbbe3653fa" exitCode=0 Jul 02 20:01:44.251404 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.251361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" event={"ID":"ffce9970-8e64-4a0a-9442-466a1b76319e","Type":"ContainerDied","Data":"5b9f4468b4e92818aae0377cc198803483bf9996d0465314b0b543bbbe3653fa"} Jul 02 20:01:44.252831 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.252809 2568 generic.go:356] "Generic (PLEG): container finished" podID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerID="c9269812588ba37018567946a5e1008ff3d3f78474bc662dbff8320364f93f6e" exitCode=0 Jul 02 20:01:44.252938 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.252893 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" event={"ID":"29fec5ba-ccfd-459f-8d55-a2b8347b78eb","Type":"ContainerDied","Data":"c9269812588ba37018567946a5e1008ff3d3f78474bc662dbff8320364f93f6e"} Jul 02 20:01:44.252997 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:44.252937 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" event={"ID":"29fec5ba-ccfd-459f-8d55-a2b8347b78eb","Type":"ContainerStarted","Data":"614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b"} Jul 02 20:01:45.259801 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.259771 2568 generic.go:356] "Generic (PLEG): container finished" podID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerID="919d13d7fd380b264406ed067b5f22804614a5956914a6e65a6ef0781f9547c1" exitCode=0 Jul 02 20:01:45.260232 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.259827 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" event={"ID":"ffce9970-8e64-4a0a-9442-466a1b76319e","Type":"ContainerDied","Data":"919d13d7fd380b264406ed067b5f22804614a5956914a6e65a6ef0781f9547c1"} Jul 02 20:01:45.261532 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.261511 2568 generic.go:356] "Generic (PLEG): container finished" podID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerID="4ca37b469b00255659afb5c5c9a6a23a083c85f25151ab200706c4d302fda420" exitCode=0 Jul 02 20:01:45.261655 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.261597 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" event={"ID":"29fec5ba-ccfd-459f-8d55-a2b8347b78eb","Type":"ContainerDied","Data":"4ca37b469b00255659afb5c5c9a6a23a083c85f25151ab200706c4d302fda420"} Jul 02 20:01:45.263737 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.263715 2568 generic.go:356] "Generic (PLEG): container finished" podID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerID="25a919a41a0079093f41166d40626f2b9d1f5fb6adb06f939e346bd2c700e13b" exitCode=0 Jul 02 20:01:45.263832 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.263800 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" event={"ID":"62e7f3f7-5ffa-49e1-b8af-b17a074d3103","Type":"ContainerDied","Data":"25a919a41a0079093f41166d40626f2b9d1f5fb6adb06f939e346bd2c700e13b"} Jul 02 20:01:45.265790 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.265743 2568 generic.go:356] "Generic (PLEG): container finished" podID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerID="30b1b0474054caae89757b59ccaf8bb44f9948a0bb9373f63d9cf2b22d297bc6" exitCode=0 Jul 02 20:01:45.265790 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.265759 2568 generic.go:356] "Generic (PLEG): container finished" podID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerID="6e1f9671997dc8e6e96cebdcae5977a388f152c80c57c67b770a0b2bef28d67a" exitCode=0 Jul 02 20:01:45.265790 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.265779 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerDied","Data":"30b1b0474054caae89757b59ccaf8bb44f9948a0bb9373f63d9cf2b22d297bc6"} Jul 02 20:01:45.265957 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:45.265804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerDied","Data":"6e1f9671997dc8e6e96cebdcae5977a388f152c80c57c67b770a0b2bef28d67a"} Jul 02 20:01:46.272819 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.272783 2568 generic.go:356] "Generic (PLEG): container finished" podID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerID="35bb2af3ebed76b5c3ef38126615f862b457e7497818e5c55414462f738ce96b" exitCode=0 Jul 02 20:01:46.273253 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.272870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" event={"ID":"29fec5ba-ccfd-459f-8d55-a2b8347b78eb","Type":"ContainerDied","Data":"35bb2af3ebed76b5c3ef38126615f862b457e7497818e5c55414462f738ce96b"} Jul 02 20:01:46.412036 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.412014 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:46.461816 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.461791 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:46.476897 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.476856 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:46.555914 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.555818 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util\") pod \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " Jul 02 20:01:46.555914 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.555862 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle\") pod \"ffce9970-8e64-4a0a-9442-466a1b76319e\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " Jul 02 20:01:46.555914 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.555913 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sx8pc\" (UniqueName: \"kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc\") pod \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.555936 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle\") pod \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.555972 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle\") pod \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556005 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util\") pod \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\" (UID: \"62e7f3f7-5ffa-49e1-b8af-b17a074d3103\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556025 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wxwmd\" (UniqueName: \"kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd\") pod \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\" (UID: \"9bb43a72-5667-452e-b741-3f8fd2fecc5d\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556075 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util\") pod \"ffce9970-8e64-4a0a-9442-466a1b76319e\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " Jul 02 20:01:46.556188 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556115 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5s86t\" (UniqueName: \"kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t\") pod \"ffce9970-8e64-4a0a-9442-466a1b76319e\" (UID: \"ffce9970-8e64-4a0a-9442-466a1b76319e\") " Jul 02 20:01:46.556577 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556533 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle" (OuterVolumeSpecName: "bundle") pod "ffce9970-8e64-4a0a-9442-466a1b76319e" (UID: "ffce9970-8e64-4a0a-9442-466a1b76319e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.556870 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.556832 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle" (OuterVolumeSpecName: "bundle") pod "62e7f3f7-5ffa-49e1-b8af-b17a074d3103" (UID: "62e7f3f7-5ffa-49e1-b8af-b17a074d3103"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.557494 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.557469 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle" (OuterVolumeSpecName: "bundle") pod "9bb43a72-5667-452e-b741-3f8fd2fecc5d" (UID: "9bb43a72-5667-452e-b741-3f8fd2fecc5d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.558756 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.558729 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t" (OuterVolumeSpecName: "kube-api-access-5s86t") pod "ffce9970-8e64-4a0a-9442-466a1b76319e" (UID: "ffce9970-8e64-4a0a-9442-466a1b76319e"). InnerVolumeSpecName "kube-api-access-5s86t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:01:46.558848 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.558817 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd" (OuterVolumeSpecName: "kube-api-access-wxwmd") pod "9bb43a72-5667-452e-b741-3f8fd2fecc5d" (UID: "9bb43a72-5667-452e-b741-3f8fd2fecc5d"). InnerVolumeSpecName "kube-api-access-wxwmd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:01:46.558848 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.558825 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc" (OuterVolumeSpecName: "kube-api-access-sx8pc") pod "62e7f3f7-5ffa-49e1-b8af-b17a074d3103" (UID: "62e7f3f7-5ffa-49e1-b8af-b17a074d3103"). InnerVolumeSpecName "kube-api-access-sx8pc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:01:46.561724 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.561694 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util" (OuterVolumeSpecName: "util") pod "9bb43a72-5667-452e-b741-3f8fd2fecc5d" (UID: "9bb43a72-5667-452e-b741-3f8fd2fecc5d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.562672 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.562654 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util" (OuterVolumeSpecName: "util") pod "ffce9970-8e64-4a0a-9442-466a1b76319e" (UID: "ffce9970-8e64-4a0a-9442-466a1b76319e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.562846 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.562826 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util" (OuterVolumeSpecName: "util") pod "62e7f3f7-5ffa-49e1-b8af-b17a074d3103" (UID: "62e7f3f7-5ffa-49e1-b8af-b17a074d3103"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:46.657201 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657180 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657201 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657201 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5s86t\" (UniqueName: \"kubernetes.io/projected/ffce9970-8e64-4a0a-9442-466a1b76319e-kube-api-access-5s86t\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657211 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657231 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ffce9970-8e64-4a0a-9442-466a1b76319e-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657241 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sx8pc\" (UniqueName: \"kubernetes.io/projected/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-kube-api-access-sx8pc\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657249 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657257 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9bb43a72-5667-452e-b741-3f8fd2fecc5d-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657264 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/62e7f3f7-5ffa-49e1-b8af-b17a074d3103-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:46.657348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:46.657272 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wxwmd\" (UniqueName: \"kubernetes.io/projected/9bb43a72-5667-452e-b741-3f8fd2fecc5d-kube-api-access-wxwmd\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:47.279219 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.279195 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" Jul 02 20:01:47.279657 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.279200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5" event={"ID":"62e7f3f7-5ffa-49e1-b8af-b17a074d3103","Type":"ContainerDied","Data":"b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec"} Jul 02 20:01:47.279657 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.279315 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b5ddfbad7100d26a75071a44b18ea7c142bc3acd4313d08378f257566248b1ec" Jul 02 20:01:47.281121 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.281103 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" Jul 02 20:01:47.281238 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.281122 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np" event={"ID":"9bb43a72-5667-452e-b741-3f8fd2fecc5d","Type":"ContainerDied","Data":"3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc"} Jul 02 20:01:47.281238 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.281157 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b3b9de99dde66519fdcdb9363789ad213e412f5b6ae9435f6f8a71c086665cc" Jul 02 20:01:47.283100 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.283067 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" event={"ID":"ffce9970-8e64-4a0a-9442-466a1b76319e","Type":"ContainerDied","Data":"ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972"} Jul 02 20:01:47.283202 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.283106 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ff335cf88f0ae400e61fc6280ef6cb6dac960a374db45f637787d20ae38c7972" Jul 02 20:01:47.283312 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.283291 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr" Jul 02 20:01:47.410327 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.410304 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:47.564601 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.564512 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srwxp\" (UniqueName: \"kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp\") pod \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " Jul 02 20:01:47.564769 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.564614 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util\") pod \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " Jul 02 20:01:47.564769 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.564645 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle\") pod \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\" (UID: \"29fec5ba-ccfd-459f-8d55-a2b8347b78eb\") " Jul 02 20:01:47.565189 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.565166 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle" (OuterVolumeSpecName: "bundle") pod "29fec5ba-ccfd-459f-8d55-a2b8347b78eb" (UID: "29fec5ba-ccfd-459f-8d55-a2b8347b78eb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:47.566544 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.566519 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp" (OuterVolumeSpecName: "kube-api-access-srwxp") pod "29fec5ba-ccfd-459f-8d55-a2b8347b78eb" (UID: "29fec5ba-ccfd-459f-8d55-a2b8347b78eb"). InnerVolumeSpecName "kube-api-access-srwxp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:01:47.570605 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.570573 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util" (OuterVolumeSpecName: "util") pod "29fec5ba-ccfd-459f-8d55-a2b8347b78eb" (UID: "29fec5ba-ccfd-459f-8d55-a2b8347b78eb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:01:47.665799 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.665766 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-util\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:47.665799 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.665793 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:47.665799 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:47.665802 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srwxp\" (UniqueName: \"kubernetes.io/projected/29fec5ba-ccfd-459f-8d55-a2b8347b78eb-kube-api-access-srwxp\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:01:48.290139 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:48.290103 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" event={"ID":"29fec5ba-ccfd-459f-8d55-a2b8347b78eb","Type":"ContainerDied","Data":"614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b"} Jul 02 20:01:48.290139 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:48.290139 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg" Jul 02 20:01:48.290605 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:01:48.290159 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="614dffe0838b42a998d447af3d5f832149577405ae6fdb3c9f533a06ca44c38b" Jul 02 20:02:04.015371 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015339 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw"] Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015645 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="pull" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015656 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="pull" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015665 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015672 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015682 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="pull" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015689 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="pull" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015697 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015703 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015711 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="util" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015716 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="util" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015721 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="util" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015726 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="util" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015734 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015739 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="extract" Jul 02 20:02:04.015739 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015745 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="util" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015750 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="util" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015762 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="pull" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015767 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="pull" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015773 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="pull" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015777 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="pull" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015784 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="util" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015789 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="util" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015793 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="extract" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015797 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="extract" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015847 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bb43a72-5667-452e-b741-3f8fd2fecc5d" containerName="extract" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015856 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="29fec5ba-ccfd-459f-8d55-a2b8347b78eb" containerName="extract" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015862 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="62e7f3f7-5ffa-49e1-b8af-b17a074d3103" containerName="extract" Jul 02 20:02:04.016242 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.015867 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ffce9970-8e64-4a0a-9442-466a1b76319e" containerName="extract" Jul 02 20:02:04.020656 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.020636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:04.023359 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.023339 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:02:04.023464 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.023448 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:02:04.024394 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.024357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-gfv48\"" Jul 02 20:02:04.032809 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.032790 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw"] Jul 02 20:02:04.214059 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.214025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjtdx\" (UniqueName: \"kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx\") pod \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" (UID: \"22440e70-bf6d-4f29-a22f-311f83dc570d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:04.314778 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.314696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjtdx\" (UniqueName: \"kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx\") pod \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" (UID: \"22440e70-bf6d-4f29-a22f-311f83dc570d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:04.336010 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.335977 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjtdx\" (UniqueName: \"kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx\") pod \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" (UID: \"22440e70-bf6d-4f29-a22f-311f83dc570d\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:04.631274 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.631246 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:04.773222 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:04.773189 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw"] Jul 02 20:02:04.774184 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:02:04.774158 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22440e70_bf6d_4f29_a22f_311f83dc570d.slice/crio-cfd9e1cea867ae0f4d266efddf15f643fa8df659ee76c90f434f9cad6ead2c6d WatchSource:0}: Error finding container cfd9e1cea867ae0f4d266efddf15f643fa8df659ee76c90f434f9cad6ead2c6d: Status 404 returned error can't find the container with id cfd9e1cea867ae0f4d266efddf15f643fa8df659ee76c90f434f9cad6ead2c6d Jul 02 20:02:05.375066 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:05.375032 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" event={"ID":"22440e70-bf6d-4f29-a22f-311f83dc570d","Type":"ContainerStarted","Data":"cfd9e1cea867ae0f4d266efddf15f643fa8df659ee76c90f434f9cad6ead2c6d"} Jul 02 20:02:07.387457 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:07.387422 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" event={"ID":"22440e70-bf6d-4f29-a22f-311f83dc570d","Type":"ContainerStarted","Data":"f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90"} Jul 02 20:02:07.387862 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:07.387602 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:07.405606 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:07.405558 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" podStartSLOduration=2.5938085600000003 podStartE2EDuration="4.405542674s" totalImagesPullingTime="1.811734114s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:07.404270059 +0000 UTC m=+437.508421144" watchObservedRunningTime="2026-07-02 20:02:07.405542674 +0000 UTC m=+437.509693766" Jul 02 20:02:17.267584 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.267502 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-d8bc7dccc-bwnh6"] Jul 02 20:02:17.271225 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.271203 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.289575 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.289553 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8bc7dccc-bwnh6"] Jul 02 20:02:17.313801 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313772 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-service-ca\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.313949 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313814 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.313949 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.313949 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313867 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-oauth-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.313949 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313927 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5n5sp\" (UniqueName: \"kubernetes.io/projected/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-kube-api-access-5n5sp\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.314148 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.313961 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-trusted-ca-bundle\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.314148 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.314034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-oauth-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414593 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414559 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5n5sp\" (UniqueName: \"kubernetes.io/projected/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-kube-api-access-5n5sp\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414603 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-trusted-ca-bundle\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414638 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-oauth-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414671 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-service-ca\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414700 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.414771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.415056 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.414911 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-oauth-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.415450 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.415423 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.415580 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.415450 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-service-ca\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.415644 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.415587 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-oauth-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.415701 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.415667 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-trusted-ca-bundle\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.417272 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.417248 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-serving-cert\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.417348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.417269 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-console-oauth-config\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.424664 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.424643 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5n5sp\" (UniqueName: \"kubernetes.io/projected/085a65f8-5d7d-4e54-83b2-5536a0d6e02b-kube-api-access-5n5sp\") pod \"console-d8bc7dccc-bwnh6\" (UID: \"085a65f8-5d7d-4e54-83b2-5536a0d6e02b\") " pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.580390 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.580298 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:17.713847 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:17.713812 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-d8bc7dccc-bwnh6"] Jul 02 20:02:17.714332 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:02:17.714305 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod085a65f8_5d7d_4e54_83b2_5536a0d6e02b.slice/crio-1ca2ba7cfab8f10a2d3a8688e569b152058dd5ddb402f040d5f96497d2df2da0 WatchSource:0}: Error finding container 1ca2ba7cfab8f10a2d3a8688e569b152058dd5ddb402f040d5f96497d2df2da0: Status 404 returned error can't find the container with id 1ca2ba7cfab8f10a2d3a8688e569b152058dd5ddb402f040d5f96497d2df2da0 Jul 02 20:02:18.398474 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:18.398450 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:18.444656 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:18.444621 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8bc7dccc-bwnh6" event={"ID":"085a65f8-5d7d-4e54-83b2-5536a0d6e02b","Type":"ContainerStarted","Data":"eec8ae540405c52d44eea49a4e6cb9b84fdb64a4dcd9812ee604370b89310fb0"} Jul 02 20:02:18.444834 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:18.444675 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-d8bc7dccc-bwnh6" event={"ID":"085a65f8-5d7d-4e54-83b2-5536a0d6e02b","Type":"ContainerStarted","Data":"1ca2ba7cfab8f10a2d3a8688e569b152058dd5ddb402f040d5f96497d2df2da0"} Jul 02 20:02:18.470060 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:18.470001 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-d8bc7dccc-bwnh6" podStartSLOduration=1.469979502 podStartE2EDuration="1.469979502s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:18.468158464 +0000 UTC m=+448.572309558" watchObservedRunningTime="2026-07-02 20:02:18.469979502 +0000 UTC m=+448.574130619" Jul 02 20:02:27.178254 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.178221 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:27.184047 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.184027 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.186562 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.186544 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-8rrsm\"" Jul 02 20:02:27.196843 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.196820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:27.220055 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.220029 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw"] Jul 02 20:02:27.220240 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.220215 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" containerName="manager" containerID="cri-o://f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90" gracePeriod=2 Jul 02 20:02:27.222572 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.222541 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.223913 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.223889 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw"] Jul 02 20:02:27.298387 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.298355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b97kd\" (UniqueName: \"kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.298556 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.298424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.399404 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.399375 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b97kd\" (UniqueName: \"kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.399536 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.399466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.399995 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.399946 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.411700 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.411671 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b97kd\" (UniqueName: \"kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd\") pod \"kuadrant-operator-controller-manager-55467d9f7-sm5hv\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.462666 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.462645 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.465041 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.465015 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.490107 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.490074 2568 generic.go:356] "Generic (PLEG): container finished" podID="22440e70-bf6d-4f29-a22f-311f83dc570d" containerID="f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90" exitCode=0 Jul 02 20:02:27.490230 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.490118 2568 scope.go:117] "RemoveContainer" containerID="f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90" Jul 02 20:02:27.490230 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.490120 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.492667 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.492642 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.494845 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.494827 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:27.498456 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.498440 2568 scope.go:117] "RemoveContainer" containerID="f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90" Jul 02 20:02:27.498707 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.498689 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90\": container with ID starting with f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90 not found: ID does not exist" containerID="f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90" Jul 02 20:02:27.498772 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.498724 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90"} err="failed to get container status \"f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90\": rpc error: code = NotFound desc = could not find container \"f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90\": container with ID starting with f6d754a12895b82c1d93cd7be81d6ae3a359781c43c3af3ddc63741ca9eeba90 not found: ID does not exist" Jul 02 20:02:27.499855 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.499836 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjtdx\" (UniqueName: \"kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx\") pod \"22440e70-bf6d-4f29-a22f-311f83dc570d\" (UID: \"22440e70-bf6d-4f29-a22f-311f83dc570d\") " Jul 02 20:02:27.501834 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.501804 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx" (OuterVolumeSpecName: "kube-api-access-tjtdx") pod "22440e70-bf6d-4f29-a22f-311f83dc570d" (UID: "22440e70-bf6d-4f29-a22f-311f83dc570d"). InnerVolumeSpecName "kube-api-access-tjtdx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:02:27.581117 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.581086 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:27.581278 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.581149 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:27.587302 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.587277 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:27.600979 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.600953 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjtdx\" (UniqueName: \"kubernetes.io/projected/22440e70-bf6d-4f29-a22f-311f83dc570d-kube-api-access-tjtdx\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:27.615243 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.615202 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:27.633192 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:27.633170 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:27.634730 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:02:27.634708 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97309b47_ef64_4bab_acd4_bd19f73c5fa3.slice/crio-5eea0602de30b75e69ee51ba972ac36feedd945794a949121efd140b2d2002fe WatchSource:0}: Error finding container 5eea0602de30b75e69ee51ba972ac36feedd945794a949121efd140b2d2002fe: Status 404 returned error can't find the container with id 5eea0602de30b75e69ee51ba972ac36feedd945794a949121efd140b2d2002fe Jul 02 20:02:27.801048 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:27.801014 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-jtfjw\" is forbidden: User \"system:node:ip-10-0-139-102.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-139-102.ec2.internal' and this object" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-jtfjw" Jul 02 20:02:28.399458 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:28.399423 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" path="/var/lib/kubelet/pods/22440e70-bf6d-4f29-a22f-311f83dc570d/volumes" Jul 02 20:02:28.499379 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:28.499325 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" event={"ID":"97309b47-ef64-4bab-acd4-bd19f73c5fa3","Type":"ContainerStarted","Data":"5eea0602de30b75e69ee51ba972ac36feedd945794a949121efd140b2d2002fe"} Jul 02 20:02:28.504274 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:28.504247 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-d8bc7dccc-bwnh6" Jul 02 20:02:28.560567 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:28.560491 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 20:02:33.529703 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:33.529659 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" event={"ID":"97309b47-ef64-4bab-acd4-bd19f73c5fa3","Type":"ContainerStarted","Data":"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc"} Jul 02 20:02:33.530090 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:33.529772 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:33.551975 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:33.551919 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" podStartSLOduration=1.421192583 podStartE2EDuration="6.551903621s" totalImagesPullingTime="5.130711038s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:02:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:02:33.549015301 +0000 UTC m=+463.653166397" watchObservedRunningTime="2026-07-02 20:02:33.551903621 +0000 UTC m=+463.656054713" Jul 02 20:02:44.537537 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:44.537507 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:53.593758 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.593695 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6c456d9b8-tzzxq" podUID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" containerName="console" containerID="cri-o://94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4" gracePeriod=15 Jul 02 20:02:53.845068 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.845018 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 20:02:53.929216 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929185 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929362 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929226 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929362 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929254 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929362 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929282 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929362 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929333 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929578 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929394 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929578 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929424 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9z2k8\" (UniqueName: \"kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8\") pod \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\" (UID: \"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f\") " Jul 02 20:02:53.929730 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929697 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:02:53.929813 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929724 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config" (OuterVolumeSpecName: "console-config") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:02:53.929813 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929759 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca" (OuterVolumeSpecName: "service-ca") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:02:53.929813 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.929764 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:02:53.931383 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.931354 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:02:53.931485 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.931384 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:02:53.931525 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:53.931510 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8" (OuterVolumeSpecName: "kube-api-access-9z2k8") pod "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" (UID: "2eeeeaf5-087a-4f7d-ae3b-de9538831a4f"). InnerVolumeSpecName "kube-api-access-9z2k8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:02:54.030728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030704 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-oauth-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030724 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9z2k8\" (UniqueName: \"kubernetes.io/projected/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-kube-api-access-9z2k8\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030894 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030733 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-serving-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030894 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030742 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-service-ca\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030894 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030750 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-trusted-ca-bundle\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030894 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030758 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-oauth-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.030894 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.030766 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f-console-config\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:54.635222 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.635183 2568 generic.go:356] "Generic (PLEG): container finished" podID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" containerID="94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4" exitCode=0 Jul 02 20:02:54.635691 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.635234 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c456d9b8-tzzxq" Jul 02 20:02:54.635691 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.635273 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c456d9b8-tzzxq" event={"ID":"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f","Type":"ContainerDied","Data":"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4"} Jul 02 20:02:54.635691 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.635328 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c456d9b8-tzzxq" event={"ID":"2eeeeaf5-087a-4f7d-ae3b-de9538831a4f","Type":"ContainerDied","Data":"52a645760829dba8446fdb4c26d69547a2f8447402ffa6cddf49b1cc861bf22c"} Jul 02 20:02:54.635691 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.635351 2568 scope.go:117] "RemoveContainer" containerID="94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4" Jul 02 20:02:54.644357 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.644339 2568 scope.go:117] "RemoveContainer" containerID="94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4" Jul 02 20:02:54.644656 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:54.644631 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4\": container with ID starting with 94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4 not found: ID does not exist" containerID="94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4" Jul 02 20:02:54.644723 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.644657 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4"} err="failed to get container status \"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4\": rpc error: code = NotFound desc = could not find container \"94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4\": container with ID starting with 94eca3e03c2489f0a8efd95b5d2580f930fcb15d7565df181e385a7849f2d0d4 not found: ID does not exist" Jul 02 20:02:54.655837 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.655785 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 20:02:54.659443 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:54.659426 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c456d9b8-tzzxq"] Jul 02 20:02:56.397369 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:56.397338 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" path="/var/lib/kubelet/pods/2eeeeaf5-087a-4f7d-ae3b-de9538831a4f/volumes" Jul 02 20:02:56.687629 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:56.687550 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:56.687767 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:56.687747 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" podUID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" containerName="manager" containerID="cri-o://925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc" gracePeriod=10 Jul 02 20:02:56.941725 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:56.941672 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:57.055810 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.055784 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b97kd\" (UniqueName: \"kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd\") pod \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " Jul 02 20:02:57.055980 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.055821 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume\") pod \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\" (UID: \"97309b47-ef64-4bab-acd4-bd19f73c5fa3\") " Jul 02 20:02:57.056230 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.056200 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "97309b47-ef64-4bab-acd4-bd19f73c5fa3" (UID: "97309b47-ef64-4bab-acd4-bd19f73c5fa3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 02 20:02:57.057770 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.057744 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd" (OuterVolumeSpecName: "kube-api-access-b97kd") pod "97309b47-ef64-4bab-acd4-bd19f73c5fa3" (UID: "97309b47-ef64-4bab-acd4-bd19f73c5fa3"). InnerVolumeSpecName "kube-api-access-b97kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:02:57.156948 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.156915 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b97kd\" (UniqueName: \"kubernetes.io/projected/97309b47-ef64-4bab-acd4-bd19f73c5fa3-kube-api-access-b97kd\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:57.156948 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.156941 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97309b47-ef64-4bab-acd4-bd19f73c5fa3-extensions-socket-volume\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:02:57.652652 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.652622 2568 generic.go:356] "Generic (PLEG): container finished" podID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" containerID="925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc" exitCode=0 Jul 02 20:02:57.653129 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.652665 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" Jul 02 20:02:57.653129 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.652669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" event={"ID":"97309b47-ef64-4bab-acd4-bd19f73c5fa3","Type":"ContainerDied","Data":"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc"} Jul 02 20:02:57.653129 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.652733 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv" event={"ID":"97309b47-ef64-4bab-acd4-bd19f73c5fa3","Type":"ContainerDied","Data":"5eea0602de30b75e69ee51ba972ac36feedd945794a949121efd140b2d2002fe"} Jul 02 20:02:57.653129 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.652766 2568 scope.go:117] "RemoveContainer" containerID="925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc" Jul 02 20:02:57.661985 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.661966 2568 scope.go:117] "RemoveContainer" containerID="925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc" Jul 02 20:02:57.662237 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:02:57.662221 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc\": container with ID starting with 925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc not found: ID does not exist" containerID="925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc" Jul 02 20:02:57.662278 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.662245 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc"} err="failed to get container status \"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc\": rpc error: code = NotFound desc = could not find container \"925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc\": container with ID starting with 925ac0d5053869cd03504c580218408d4a12692d3c5b5513eda9c7045fa6d5cc not found: ID does not exist" Jul 02 20:02:57.677236 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.677199 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:57.681673 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:57.681633 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sm5hv"] Jul 02 20:02:58.397104 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:02:58.397069 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" path="/var/lib/kubelet/pods/97309b47-ef64-4bab-acd4-bd19f73c5fa3/volumes" Jul 02 20:03:00.923090 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923058 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns"] Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923378 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" containerName="console" Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923389 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" containerName="console" Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923398 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" containerName="manager" Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923403 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" containerName="manager" Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923414 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" containerName="manager" Jul 02 20:03:00.923442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923420 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" containerName="manager" Jul 02 20:03:00.923655 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923477 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22440e70-bf6d-4f29-a22f-311f83dc570d" containerName="manager" Jul 02 20:03:00.923655 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923488 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="97309b47-ef64-4bab-acd4-bd19f73c5fa3" containerName="manager" Jul 02 20:03:00.923655 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.923495 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2eeeeaf5-087a-4f7d-ae3b-de9538831a4f" containerName="console" Jul 02 20:03:00.928327 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.928311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:00.931206 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.931189 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-lwl5w\"" Jul 02 20:03:00.940092 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:00.940069 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns"] Jul 02 20:03:01.089162 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089134 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089324 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089172 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089324 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089197 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089324 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089324 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089362 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-png4x\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-kube-api-access-png4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.089476 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.089442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190427 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-png4x\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-kube-api-access-png4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190427 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190395 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190427 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190462 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190480 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190496 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190570 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.190670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190639 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.191026 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190867 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.191026 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.190961 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.191026 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.191014 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.191176 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.191156 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.191262 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.191241 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.192956 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.192935 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.193152 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.193133 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.199011 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.198990 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.199165 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.199061 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-png4x\" (UniqueName: \"kubernetes.io/projected/5894ab32-c564-4a96-afbc-e7bc4b46be7d-kube-api-access-png4x\") pod \"maas-default-gateway-openshift-default-56654dcf7-r92ns\" (UID: \"5894ab32-c564-4a96-afbc-e7bc4b46be7d\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.237985 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.237964 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:01.366853 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.366828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns"] Jul 02 20:03:01.368181 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:01.368159 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5894ab32_c564_4a96_afbc_e7bc4b46be7d.slice/crio-ffb9482fe69340ff5adde622cf82234174a52144e7974c46abdf3ae4a5ae5bbc WatchSource:0}: Error finding container ffb9482fe69340ff5adde622cf82234174a52144e7974c46abdf3ae4a5ae5bbc: Status 404 returned error can't find the container with id ffb9482fe69340ff5adde622cf82234174a52144e7974c46abdf3ae4a5ae5bbc Jul 02 20:03:01.370314 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.370282 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:03:01.370399 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.370343 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:03:01.370399 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.370375 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 02 20:03:01.675690 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.675651 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" event={"ID":"5894ab32-c564-4a96-afbc-e7bc4b46be7d","Type":"ContainerStarted","Data":"5e9ac71ecfca9451e961554273ddfe325636fc81cc3a10330eeddcc30745fcf2"} Jul 02 20:03:01.675998 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.675719 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" event={"ID":"5894ab32-c564-4a96-afbc-e7bc4b46be7d","Type":"ContainerStarted","Data":"ffb9482fe69340ff5adde622cf82234174a52144e7974c46abdf3ae4a5ae5bbc"} Jul 02 20:03:01.694889 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:01.694838 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" podStartSLOduration=1.694823636 podStartE2EDuration="1.694823636s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:01.693105122 +0000 UTC m=+491.797256216" watchObservedRunningTime="2026-07-02 20:03:01.694823636 +0000 UTC m=+491.798974729" Jul 02 20:03:02.238979 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:02.238946 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:02.243377 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:02.243353 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:02.680479 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:02.680451 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:02.681343 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:02.681323 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r92ns" Jul 02 20:03:16.997963 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:16.997929 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:17.000061 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.000045 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.002583 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.002558 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 02 20:03:17.002719 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.002590 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 02 20:03:17.002719 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.002606 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-dzpvl\"" Jul 02 20:03:17.003599 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.003583 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 02 20:03:17.009288 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.009268 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:17.100698 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.100670 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:17.125451 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.125416 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.125609 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.125453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7hsq\" (UniqueName: \"kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.226771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.226738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.226980 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.226799 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7hsq\" (UniqueName: \"kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.227594 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.227561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.240052 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.240032 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7hsq\" (UniqueName: \"kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq\") pod \"limitador-limitador-64c94fd64f-qdxmt\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.310988 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.310911 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:17.446203 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.446171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:17.447618 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:17.447595 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab39f65f_4750_4e51_8383_4bdb64cdca86.slice/crio-4b203dcd4578935f6f9f828fb910d1a83598f7111bf514dbc6e0ca4d2ff0e323 WatchSource:0}: Error finding container 4b203dcd4578935f6f9f828fb910d1a83598f7111bf514dbc6e0ca4d2ff0e323: Status 404 returned error can't find the container with id 4b203dcd4578935f6f9f828fb910d1a83598f7111bf514dbc6e0ca4d2ff0e323 Jul 02 20:03:17.757998 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.757967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" event={"ID":"ab39f65f-4750-4e51-8383-4bdb64cdca86","Type":"ContainerStarted","Data":"4b203dcd4578935f6f9f828fb910d1a83598f7111bf514dbc6e0ca4d2ff0e323"} Jul 02 20:03:17.841540 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.841508 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:17.843547 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.843527 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:17.846182 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.846163 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-2hvhm\"" Jul 02 20:03:17.852337 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.852315 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:17.933166 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:17.933130 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44vh9\" (UniqueName: \"kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9\") pod \"authorino-58cd955675-swmwd\" (UID: \"27df8992-0f0f-44f0-8c18-f460ef065c6e\") " pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:18.011864 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.011780 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:18.014521 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.014498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:18.033297 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.033164 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:18.034569 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.034206 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44vh9\" (UniqueName: \"kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9\") pod \"authorino-58cd955675-swmwd\" (UID: \"27df8992-0f0f-44f0-8c18-f460ef065c6e\") " pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:18.061042 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.060948 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-44vh9\" (UniqueName: \"kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9\") pod \"authorino-58cd955675-swmwd\" (UID: \"27df8992-0f0f-44f0-8c18-f460ef065c6e\") " pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:18.135720 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.135571 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b25nt\" (UniqueName: \"kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt\") pod \"authorino-75d556bd77-ltk85\" (UID: \"a2228cb6-46f9-491a-93a5-ba26dc36df41\") " pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:18.154422 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.154387 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:18.237705 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.237581 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b25nt\" (UniqueName: \"kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt\") pod \"authorino-75d556bd77-ltk85\" (UID: \"a2228cb6-46f9-491a-93a5-ba26dc36df41\") " pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:18.254263 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.254234 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b25nt\" (UniqueName: \"kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt\") pod \"authorino-75d556bd77-ltk85\" (UID: \"a2228cb6-46f9-491a-93a5-ba26dc36df41\") " pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:18.332862 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.332830 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:18.334549 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:18.334521 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod27df8992_0f0f_44f0_8c18_f460ef065c6e.slice/crio-039d75ddc63bf95909915297abc142b32a9435a1bdd8f376360505160993dde1 WatchSource:0}: Error finding container 039d75ddc63bf95909915297abc142b32a9435a1bdd8f376360505160993dde1: Status 404 returned error can't find the container with id 039d75ddc63bf95909915297abc142b32a9435a1bdd8f376360505160993dde1 Jul 02 20:03:18.336642 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.336601 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:18.490296 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.490177 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:18.493385 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:18.493340 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2228cb6_46f9_491a_93a5_ba26dc36df41.slice/crio-b228954de5fd44f575a947afbdf25d67febec787dedf36942a35535b91921967 WatchSource:0}: Error finding container b228954de5fd44f575a947afbdf25d67febec787dedf36942a35535b91921967: Status 404 returned error can't find the container with id b228954de5fd44f575a947afbdf25d67febec787dedf36942a35535b91921967 Jul 02 20:03:18.768235 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.768197 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ltk85" event={"ID":"a2228cb6-46f9-491a-93a5-ba26dc36df41","Type":"ContainerStarted","Data":"b228954de5fd44f575a947afbdf25d67febec787dedf36942a35535b91921967"} Jul 02 20:03:18.769539 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:18.769513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swmwd" event={"ID":"27df8992-0f0f-44f0-8c18-f460ef065c6e","Type":"ContainerStarted","Data":"039d75ddc63bf95909915297abc142b32a9435a1bdd8f376360505160993dde1"} Jul 02 20:03:20.785789 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:20.785755 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" event={"ID":"ab39f65f-4750-4e51-8383-4bdb64cdca86","Type":"ContainerStarted","Data":"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153"} Jul 02 20:03:20.786304 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:20.785969 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:20.805718 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:20.805660 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" podStartSLOduration=2.109790279 podStartE2EDuration="4.805638585s" totalImagesPullingTime="2.695848306s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:20.802667167 +0000 UTC m=+510.906818262" watchObservedRunningTime="2026-07-02 20:03:20.805638585 +0000 UTC m=+510.909789679" Jul 02 20:03:22.797526 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:22.797488 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ltk85" event={"ID":"a2228cb6-46f9-491a-93a5-ba26dc36df41","Type":"ContainerStarted","Data":"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f"} Jul 02 20:03:22.799192 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:22.799162 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swmwd" event={"ID":"27df8992-0f0f-44f0-8c18-f460ef065c6e","Type":"ContainerStarted","Data":"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b"} Jul 02 20:03:22.813209 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:22.813168 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-ltk85" podStartSLOduration=1.72456315 podStartE2EDuration="5.813153104s" totalImagesPullingTime="4.088589954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:22.81145342 +0000 UTC m=+512.915604523" watchObservedRunningTime="2026-07-02 20:03:22.813153104 +0000 UTC m=+512.917304196" Jul 02 20:03:22.829457 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:22.829360 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-swmwd" podStartSLOduration=1.586070867 podStartE2EDuration="5.829342236s" totalImagesPullingTime="4.243271369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:22.827788905 +0000 UTC m=+512.931940000" watchObservedRunningTime="2026-07-02 20:03:22.829342236 +0000 UTC m=+512.933493330" Jul 02 20:03:22.857220 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:22.857192 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:24.809269 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:24.809229 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-swmwd" podUID="27df8992-0f0f-44f0-8c18-f460ef065c6e" containerName="authorino" containerID="cri-o://4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b" gracePeriod=30 Jul 02 20:03:25.054815 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.054792 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:25.199605 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.199574 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44vh9\" (UniqueName: \"kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9\") pod \"27df8992-0f0f-44f0-8c18-f460ef065c6e\" (UID: \"27df8992-0f0f-44f0-8c18-f460ef065c6e\") " Jul 02 20:03:25.201637 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.201612 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9" (OuterVolumeSpecName: "kube-api-access-44vh9") pod "27df8992-0f0f-44f0-8c18-f460ef065c6e" (UID: "27df8992-0f0f-44f0-8c18-f460ef065c6e"). InnerVolumeSpecName "kube-api-access-44vh9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:03:25.300536 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.300500 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44vh9\" (UniqueName: \"kubernetes.io/projected/27df8992-0f0f-44f0-8c18-f460ef065c6e-kube-api-access-44vh9\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:03:25.815651 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.815612 2568 generic.go:356] "Generic (PLEG): container finished" podID="27df8992-0f0f-44f0-8c18-f460ef065c6e" containerID="4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b" exitCode=0 Jul 02 20:03:25.815651 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.815657 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-swmwd" Jul 02 20:03:25.816151 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.815694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swmwd" event={"ID":"27df8992-0f0f-44f0-8c18-f460ef065c6e","Type":"ContainerDied","Data":"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b"} Jul 02 20:03:25.816151 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.815735 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-swmwd" event={"ID":"27df8992-0f0f-44f0-8c18-f460ef065c6e","Type":"ContainerDied","Data":"039d75ddc63bf95909915297abc142b32a9435a1bdd8f376360505160993dde1"} Jul 02 20:03:25.816151 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.815755 2568 scope.go:117] "RemoveContainer" containerID="4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b" Jul 02 20:03:25.824620 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.824603 2568 scope.go:117] "RemoveContainer" containerID="4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b" Jul 02 20:03:25.824850 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:25.824831 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b\": container with ID starting with 4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b not found: ID does not exist" containerID="4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b" Jul 02 20:03:25.824907 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.824859 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b"} err="failed to get container status \"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b\": rpc error: code = NotFound desc = could not find container \"4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b\": container with ID starting with 4629466195a20599f2b5edb81d56f11e956cbbe0de6c919e1e03b924cecc423b not found: ID does not exist" Jul 02 20:03:25.837775 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.837755 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:25.844252 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:25.844230 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-swmwd"] Jul 02 20:03:26.398354 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:26.398323 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="27df8992-0f0f-44f0-8c18-f460ef065c6e" path="/var/lib/kubelet/pods/27df8992-0f0f-44f0-8c18-f460ef065c6e/volumes" Jul 02 20:03:31.792923 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:31.792890 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:31.835289 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:31.835258 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:31.854224 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:31.854184 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" podUID="ab39f65f-4750-4e51-8383-4bdb64cdca86" containerName="limitador" containerID="cri-o://a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153" gracePeriod=30 Jul 02 20:03:32.797665 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.797641 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:32.860543 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.860509 2568 generic.go:356] "Generic (PLEG): container finished" podID="ab39f65f-4750-4e51-8383-4bdb64cdca86" containerID="a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153" exitCode=0 Jul 02 20:03:32.860689 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.860555 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" Jul 02 20:03:32.860689 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.860553 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" event={"ID":"ab39f65f-4750-4e51-8383-4bdb64cdca86","Type":"ContainerDied","Data":"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153"} Jul 02 20:03:32.860689 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.860669 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-qdxmt" event={"ID":"ab39f65f-4750-4e51-8383-4bdb64cdca86","Type":"ContainerDied","Data":"4b203dcd4578935f6f9f828fb910d1a83598f7111bf514dbc6e0ca4d2ff0e323"} Jul 02 20:03:32.860793 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.860697 2568 scope.go:117] "RemoveContainer" containerID="a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153" Jul 02 20:03:32.869280 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.869262 2568 scope.go:117] "RemoveContainer" containerID="a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153" Jul 02 20:03:32.869531 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:32.869515 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153\": container with ID starting with a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153 not found: ID does not exist" containerID="a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153" Jul 02 20:03:32.869590 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.869538 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153"} err="failed to get container status \"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153\": rpc error: code = NotFound desc = could not find container \"a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153\": container with ID starting with a32d26c977aec47e1062de6c3447e1a7538c9daa8bb5f8f6460a0b7fb3340153 not found: ID does not exist" Jul 02 20:03:32.967573 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.967502 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7hsq\" (UniqueName: \"kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq\") pod \"ab39f65f-4750-4e51-8383-4bdb64cdca86\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " Jul 02 20:03:32.967573 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.967540 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file\") pod \"ab39f65f-4750-4e51-8383-4bdb64cdca86\" (UID: \"ab39f65f-4750-4e51-8383-4bdb64cdca86\") " Jul 02 20:03:32.967958 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.967934 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file" (OuterVolumeSpecName: "config-file") pod "ab39f65f-4750-4e51-8383-4bdb64cdca86" (UID: "ab39f65f-4750-4e51-8383-4bdb64cdca86"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 02 20:03:32.969533 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:32.969515 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq" (OuterVolumeSpecName: "kube-api-access-p7hsq") pod "ab39f65f-4750-4e51-8383-4bdb64cdca86" (UID: "ab39f65f-4750-4e51-8383-4bdb64cdca86"). InnerVolumeSpecName "kube-api-access-p7hsq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:03:33.069131 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:33.069106 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7hsq\" (UniqueName: \"kubernetes.io/projected/ab39f65f-4750-4e51-8383-4bdb64cdca86-kube-api-access-p7hsq\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:03:33.069131 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:33.069128 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/ab39f65f-4750-4e51-8383-4bdb64cdca86-config-file\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:03:33.182464 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:33.182438 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:33.187686 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:33.187664 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-qdxmt"] Jul 02 20:03:34.397511 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.397475 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ab39f65f-4750-4e51-8383-4bdb64cdca86" path="/var/lib/kubelet/pods/ab39f65f-4750-4e51-8383-4bdb64cdca86/volumes" Jul 02 20:03:34.534346 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534308 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-7xdks"] Jul 02 20:03:34.534677 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534657 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ab39f65f-4750-4e51-8383-4bdb64cdca86" containerName="limitador" Jul 02 20:03:34.534677 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534675 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ab39f65f-4750-4e51-8383-4bdb64cdca86" containerName="limitador" Jul 02 20:03:34.534896 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534700 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="27df8992-0f0f-44f0-8c18-f460ef065c6e" containerName="authorino" Jul 02 20:03:34.534896 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534709 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="27df8992-0f0f-44f0-8c18-f460ef065c6e" containerName="authorino" Jul 02 20:03:34.534896 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534793 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ab39f65f-4750-4e51-8383-4bdb64cdca86" containerName="limitador" Jul 02 20:03:34.534896 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.534803 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="27df8992-0f0f-44f0-8c18-f460ef065c6e" containerName="authorino" Jul 02 20:03:34.537535 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.537514 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.546235 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.544869 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hct2x\"" Jul 02 20:03:34.546235 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.544909 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jul 02 20:03:34.550049 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.550010 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7xdks"] Jul 02 20:03:34.682309 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.682229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c43be586-1f43-4bcf-bda8-4da94a362181-data\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.682309 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.682268 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4tx9s\" (UniqueName: \"kubernetes.io/projected/c43be586-1f43-4bcf-bda8-4da94a362181-kube-api-access-4tx9s\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.783727 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.783696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c43be586-1f43-4bcf-bda8-4da94a362181-data\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.783727 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.783734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4tx9s\" (UniqueName: \"kubernetes.io/projected/c43be586-1f43-4bcf-bda8-4da94a362181-kube-api-access-4tx9s\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.784114 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.784095 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/c43be586-1f43-4bcf-bda8-4da94a362181-data\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.792139 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.792117 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4tx9s\" (UniqueName: \"kubernetes.io/projected/c43be586-1f43-4bcf-bda8-4da94a362181-kube-api-access-4tx9s\") pod \"postgres-69fb4594cf-7xdks\" (UID: \"c43be586-1f43-4bcf-bda8-4da94a362181\") " pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.856710 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.856681 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:34.983731 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:34.983704 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-7xdks"] Jul 02 20:03:34.985279 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:34.985253 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc43be586_1f43_4bcf_bda8_4da94a362181.slice/crio-84880d74fd519ebdafa333f4a10c6d9bbaa81272ea52f395c8d26cb828f55d86 WatchSource:0}: Error finding container 84880d74fd519ebdafa333f4a10c6d9bbaa81272ea52f395c8d26cb828f55d86: Status 404 returned error can't find the container with id 84880d74fd519ebdafa333f4a10c6d9bbaa81272ea52f395c8d26cb828f55d86 Jul 02 20:03:35.883493 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:35.883454 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7xdks" event={"ID":"c43be586-1f43-4bcf-bda8-4da94a362181","Type":"ContainerStarted","Data":"84880d74fd519ebdafa333f4a10c6d9bbaa81272ea52f395c8d26cb828f55d86"} Jul 02 20:03:39.907891 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:39.907855 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-7xdks" event={"ID":"c43be586-1f43-4bcf-bda8-4da94a362181","Type":"ContainerStarted","Data":"3aa9f03aceea378cfc8a5e89211975069f52fe69df03e4db999a4e44ae5c66c0"} Jul 02 20:03:39.908172 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:39.907991 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:39.934945 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:39.934892 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-7xdks" podStartSLOduration=1.088566501 podStartE2EDuration="5.934858613s" totalImagesPullingTime="4.846292112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:39.932644728 +0000 UTC m=+530.036795821" watchObservedRunningTime="2026-07-02 20:03:39.934858613 +0000 UTC m=+530.039009706" Jul 02 20:03:45.943040 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:45.942971 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-7xdks" Jul 02 20:03:46.507310 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.507271 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:46.510689 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.510671 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:46.518936 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.518910 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:46.593356 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.593303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w7k5n\" (UniqueName: \"kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n\") pod \"authorino-5d4b67c446-dln57\" (UID: \"8698443e-4a66-4154-8c38-9dcb67590acc\") " pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:46.694742 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.694690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w7k5n\" (UniqueName: \"kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n\") pod \"authorino-5d4b67c446-dln57\" (UID: \"8698443e-4a66-4154-8c38-9dcb67590acc\") " pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:46.703096 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.703066 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w7k5n\" (UniqueName: \"kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n\") pod \"authorino-5d4b67c446-dln57\" (UID: \"8698443e-4a66-4154-8c38-9dcb67590acc\") " pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:46.741598 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.741558 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:46.741863 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.741847 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:46.871095 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.871072 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:46.872380 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:46.872352 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8698443e_4a66_4154_8c38_9dcb67590acc.slice/crio-fca7fd29446ace46b29fab76c71bbab660073a4cd61c78a449dc87cbac1f5523 WatchSource:0}: Error finding container fca7fd29446ace46b29fab76c71bbab660073a4cd61c78a449dc87cbac1f5523: Status 404 returned error can't find the container with id fca7fd29446ace46b29fab76c71bbab660073a4cd61c78a449dc87cbac1f5523 Jul 02 20:03:46.946608 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:46.946574 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dln57" event={"ID":"8698443e-4a66-4154-8c38-9dcb67590acc","Type":"ContainerStarted","Data":"fca7fd29446ace46b29fab76c71bbab660073a4cd61c78a449dc87cbac1f5523"} Jul 02 20:03:47.061113 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.061030 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7f96bb8557-t7kcj"] Jul 02 20:03:47.065419 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.065400 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.067862 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.067842 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 02 20:03:47.073341 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.073322 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f96bb8557-t7kcj"] Jul 02 20:03:47.098606 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.098568 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzv96\" (UniqueName: \"kubernetes.io/projected/342c2d23-7517-4288-acd2-9d4bb9938fa2-kube-api-access-zzv96\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.098606 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.098604 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/342c2d23-7517-4288-acd2-9d4bb9938fa2-tls-cert\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.199691 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.199655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/342c2d23-7517-4288-acd2-9d4bb9938fa2-tls-cert\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.199858 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.199769 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzv96\" (UniqueName: \"kubernetes.io/projected/342c2d23-7517-4288-acd2-9d4bb9938fa2-kube-api-access-zzv96\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.202148 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.202129 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/342c2d23-7517-4288-acd2-9d4bb9938fa2-tls-cert\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.209337 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.209316 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzv96\" (UniqueName: \"kubernetes.io/projected/342c2d23-7517-4288-acd2-9d4bb9938fa2-kube-api-access-zzv96\") pod \"authorino-7f96bb8557-t7kcj\" (UID: \"342c2d23-7517-4288-acd2-9d4bb9938fa2\") " pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.375824 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.375764 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7f96bb8557-t7kcj" Jul 02 20:03:47.540327 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.540305 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7f96bb8557-t7kcj"] Jul 02 20:03:47.541248 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:47.541220 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod342c2d23_7517_4288_acd2_9d4bb9938fa2.slice/crio-1acc949d2597bbb24a53f32ca5449d8c5c602e79c53d65fa9d5b4a18bf67ab6b WatchSource:0}: Error finding container 1acc949d2597bbb24a53f32ca5449d8c5c602e79c53d65fa9d5b4a18bf67ab6b: Status 404 returned error can't find the container with id 1acc949d2597bbb24a53f32ca5449d8c5c602e79c53d65fa9d5b4a18bf67ab6b Jul 02 20:03:47.952678 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.952645 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dln57" event={"ID":"8698443e-4a66-4154-8c38-9dcb67590acc","Type":"ContainerStarted","Data":"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b"} Jul 02 20:03:47.953128 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.952694 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-dln57" podUID="8698443e-4a66-4154-8c38-9dcb67590acc" containerName="authorino" containerID="cri-o://d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b" gracePeriod=30 Jul 02 20:03:47.953921 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.953896 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f96bb8557-t7kcj" event={"ID":"342c2d23-7517-4288-acd2-9d4bb9938fa2","Type":"ContainerStarted","Data":"1acc949d2597bbb24a53f32ca5449d8c5c602e79c53d65fa9d5b4a18bf67ab6b"} Jul 02 20:03:47.971167 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:47.971125 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-dln57" podStartSLOduration=1.522966654 podStartE2EDuration="1.971110348s" totalImagesPullingTime="448.143694ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:47.969153376 +0000 UTC m=+538.073304461" watchObservedRunningTime="2026-07-02 20:03:47.971110348 +0000 UTC m=+538.075261441" Jul 02 20:03:48.218121 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.218093 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:48.309782 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.309744 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w7k5n\" (UniqueName: \"kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n\") pod \"8698443e-4a66-4154-8c38-9dcb67590acc\" (UID: \"8698443e-4a66-4154-8c38-9dcb67590acc\") " Jul 02 20:03:48.311791 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.311760 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n" (OuterVolumeSpecName: "kube-api-access-w7k5n") pod "8698443e-4a66-4154-8c38-9dcb67590acc" (UID: "8698443e-4a66-4154-8c38-9dcb67590acc"). InnerVolumeSpecName "kube-api-access-w7k5n". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:03:48.410743 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.410706 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w7k5n\" (UniqueName: \"kubernetes.io/projected/8698443e-4a66-4154-8c38-9dcb67590acc-kube-api-access-w7k5n\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:03:48.960926 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.960820 2568 generic.go:356] "Generic (PLEG): container finished" podID="8698443e-4a66-4154-8c38-9dcb67590acc" containerID="d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b" exitCode=0 Jul 02 20:03:48.960926 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.960863 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-dln57" Jul 02 20:03:48.960926 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.960915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dln57" event={"ID":"8698443e-4a66-4154-8c38-9dcb67590acc","Type":"ContainerDied","Data":"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b"} Jul 02 20:03:48.961468 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.960970 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-dln57" event={"ID":"8698443e-4a66-4154-8c38-9dcb67590acc","Type":"ContainerDied","Data":"fca7fd29446ace46b29fab76c71bbab660073a4cd61c78a449dc87cbac1f5523"} Jul 02 20:03:48.961468 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.960997 2568 scope.go:117] "RemoveContainer" containerID="d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b" Jul 02 20:03:48.962597 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.962565 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7f96bb8557-t7kcj" event={"ID":"342c2d23-7517-4288-acd2-9d4bb9938fa2","Type":"ContainerStarted","Data":"a860d3b9bfc80c0f62f58906ba140557c6da35dfb34cbd5a5c336cf3a88835f7"} Jul 02 20:03:48.969598 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.969581 2568 scope.go:117] "RemoveContainer" containerID="d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b" Jul 02 20:03:48.969845 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:48.969820 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b\": container with ID starting with d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b not found: ID does not exist" containerID="d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b" Jul 02 20:03:48.969932 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.969857 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b"} err="failed to get container status \"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b\": rpc error: code = NotFound desc = could not find container \"d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b\": container with ID starting with d7afcf27666b7516fd0d22ee0c73c13b516706e0d3c3b6bb0b3df3147c50c79b not found: ID does not exist" Jul 02 20:03:48.977720 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.977701 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:48.981160 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.981129 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-dln57"] Jul 02 20:03:48.993300 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:48.993249 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7f96bb8557-t7kcj" podStartSLOduration=1.566502276 podStartE2EDuration="1.99322552s" totalImagesPullingTime="426.723244ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:48.992825946 +0000 UTC m=+539.096977040" watchObservedRunningTime="2026-07-02 20:03:48.99322552 +0000 UTC m=+539.097376613" Jul 02 20:03:49.020078 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.020042 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:49.020285 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.020257 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-ltk85" podUID="a2228cb6-46f9-491a-93a5-ba26dc36df41" containerName="authorino" containerID="cri-o://d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f" gracePeriod=30 Jul 02 20:03:49.309899 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.309853 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:49.419407 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.419373 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b25nt\" (UniqueName: \"kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt\") pod \"a2228cb6-46f9-491a-93a5-ba26dc36df41\" (UID: \"a2228cb6-46f9-491a-93a5-ba26dc36df41\") " Jul 02 20:03:49.421425 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.421403 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt" (OuterVolumeSpecName: "kube-api-access-b25nt") pod "a2228cb6-46f9-491a-93a5-ba26dc36df41" (UID: "a2228cb6-46f9-491a-93a5-ba26dc36df41"). InnerVolumeSpecName "kube-api-access-b25nt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:03:49.520769 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.520691 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b25nt\" (UniqueName: \"kubernetes.io/projected/a2228cb6-46f9-491a-93a5-ba26dc36df41-kube-api-access-b25nt\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:03:49.970101 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.970060 2568 generic.go:356] "Generic (PLEG): container finished" podID="a2228cb6-46f9-491a-93a5-ba26dc36df41" containerID="d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f" exitCode=0 Jul 02 20:03:49.970500 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.970112 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-ltk85" Jul 02 20:03:49.970500 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.970146 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ltk85" event={"ID":"a2228cb6-46f9-491a-93a5-ba26dc36df41","Type":"ContainerDied","Data":"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f"} Jul 02 20:03:49.970500 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.970187 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-ltk85" event={"ID":"a2228cb6-46f9-491a-93a5-ba26dc36df41","Type":"ContainerDied","Data":"b228954de5fd44f575a947afbdf25d67febec787dedf36942a35535b91921967"} Jul 02 20:03:49.970500 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.970208 2568 scope.go:117] "RemoveContainer" containerID="d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f" Jul 02 20:03:49.979071 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.979051 2568 scope.go:117] "RemoveContainer" containerID="d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f" Jul 02 20:03:49.979294 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:49.979274 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f\": container with ID starting with d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f not found: ID does not exist" containerID="d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f" Jul 02 20:03:49.979340 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.979302 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f"} err="failed to get container status \"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f\": rpc error: code = NotFound desc = could not find container \"d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f\": container with ID starting with d964301d6dec8102d01d647ef1ca7fdc000daed20c053f3023c94d5a874a006f not found: ID does not exist" Jul 02 20:03:49.991522 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.991500 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:49.995288 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:49.995270 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-ltk85"] Jul 02 20:03:50.397499 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:50.397472 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8698443e-4a66-4154-8c38-9dcb67590acc" path="/var/lib/kubelet/pods/8698443e-4a66-4154-8c38-9dcb67590acc/volumes" Jul 02 20:03:50.397776 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:50.397764 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2228cb6-46f9-491a-93a5-ba26dc36df41" path="/var/lib/kubelet/pods/a2228cb6-46f9-491a-93a5-ba26dc36df41/volumes" Jul 02 20:03:53.315857 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.315828 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:03:53.316252 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316208 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2228cb6-46f9-491a-93a5-ba26dc36df41" containerName="authorino" Jul 02 20:03:53.316252 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316221 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2228cb6-46f9-491a-93a5-ba26dc36df41" containerName="authorino" Jul 02 20:03:53.316252 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316236 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8698443e-4a66-4154-8c38-9dcb67590acc" containerName="authorino" Jul 02 20:03:53.316252 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316242 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8698443e-4a66-4154-8c38-9dcb67590acc" containerName="authorino" Jul 02 20:03:53.316419 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316299 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8698443e-4a66-4154-8c38-9dcb67590acc" containerName="authorino" Jul 02 20:03:53.316419 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.316307 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2228cb6-46f9-491a-93a5-ba26dc36df41" containerName="authorino" Jul 02 20:03:53.503633 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.503599 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:03:53.503797 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.503707 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:53.506572 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.506545 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 02 20:03:53.506716 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.506544 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 02 20:03:53.506916 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.506896 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-86nht\"" Jul 02 20:03:53.553978 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.553954 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:53.554203 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.554165 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:53.654950 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.654918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:53.655091 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.654973 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:53.655091 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:53.655054 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 02 20:03:53.655169 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:03:53.655122 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert podName:defcfcab-ffb1-4203-8b69-4381d82c703b nodeName:}" failed. No retries permitted until 2026-07-02 20:03:54.155107847 +0000 UTC m=+544.259258918 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert") pod "maas-controller-5d959ff4bc-lgbbm" (UID: "defcfcab-ffb1-4203-8b69-4381d82c703b") : secret "maas-controller-webhook-cert" not found Jul 02 20:03:53.662897 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:53.662861 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:54.159152 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:54.159113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:54.161586 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:54.161561 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") pod \"maas-controller-5d959ff4bc-lgbbm\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:54.415189 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:54.415119 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:54.543401 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:54.543378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:03:54.545796 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:03:54.545773 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddefcfcab_ffb1_4203_8b69_4381d82c703b.slice/crio-06b0529c5e9e5b121c7ef7720d8b829f8f9c5760bf3b935507279fde5cd8ae80 WatchSource:0}: Error finding container 06b0529c5e9e5b121c7ef7720d8b829f8f9c5760bf3b935507279fde5cd8ae80: Status 404 returned error can't find the container with id 06b0529c5e9e5b121c7ef7720d8b829f8f9c5760bf3b935507279fde5cd8ae80 Jul 02 20:03:55.005796 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:55.005763 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" event={"ID":"defcfcab-ffb1-4203-8b69-4381d82c703b","Type":"ContainerStarted","Data":"06b0529c5e9e5b121c7ef7720d8b829f8f9c5760bf3b935507279fde5cd8ae80"} Jul 02 20:03:57.018179 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:57.018142 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" event={"ID":"defcfcab-ffb1-4203-8b69-4381d82c703b","Type":"ContainerStarted","Data":"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69"} Jul 02 20:03:57.018562 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:57.018254 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:03:57.048015 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:03:57.047970 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" podStartSLOduration=2.195159224 podStartE2EDuration="4.047955482s" totalImagesPullingTime="1.852796258s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:03:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:03:57.045411324 +0000 UTC m=+547.149562408" watchObservedRunningTime="2026-07-02 20:03:57.047955482 +0000 UTC m=+547.152106575" Jul 02 20:04:08.029957 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.029927 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:04:08.504108 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.504077 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:04:08.504307 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.504263 2568 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" podUID="defcfcab-ffb1-4203-8b69-4381d82c703b" containerName="manager" containerID="cri-o://2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69" gracePeriod=30 Jul 02 20:04:08.747895 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.747862 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:04:08.889185 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.889156 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc\") pod \"defcfcab-ffb1-4203-8b69-4381d82c703b\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " Jul 02 20:04:08.889353 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.889248 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") pod \"defcfcab-ffb1-4203-8b69-4381d82c703b\" (UID: \"defcfcab-ffb1-4203-8b69-4381d82c703b\") " Jul 02 20:04:08.891314 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.891286 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc" (OuterVolumeSpecName: "kube-api-access-488gc") pod "defcfcab-ffb1-4203-8b69-4381d82c703b" (UID: "defcfcab-ffb1-4203-8b69-4381d82c703b"). InnerVolumeSpecName "kube-api-access-488gc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 02 20:04:08.891412 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.891392 2568 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "defcfcab-ffb1-4203-8b69-4381d82c703b" (UID: "defcfcab-ffb1-4203-8b69-4381d82c703b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 02 20:04:08.989808 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.989777 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-488gc\" (UniqueName: \"kubernetes.io/projected/defcfcab-ffb1-4203-8b69-4381d82c703b-kube-api-access-488gc\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:04:08.989808 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:08.989803 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/defcfcab-ffb1-4203-8b69-4381d82c703b-webhook-cert\") on node \"ip-10-0-139-102.ec2.internal\" DevicePath \"\"" Jul 02 20:04:09.085411 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.085379 2568 generic.go:356] "Generic (PLEG): container finished" podID="defcfcab-ffb1-4203-8b69-4381d82c703b" containerID="2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69" exitCode=0 Jul 02 20:04:09.085784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.085430 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" Jul 02 20:04:09.085784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.085467 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" event={"ID":"defcfcab-ffb1-4203-8b69-4381d82c703b","Type":"ContainerDied","Data":"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69"} Jul 02 20:04:09.085784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.085518 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d959ff4bc-lgbbm" event={"ID":"defcfcab-ffb1-4203-8b69-4381d82c703b","Type":"ContainerDied","Data":"06b0529c5e9e5b121c7ef7720d8b829f8f9c5760bf3b935507279fde5cd8ae80"} Jul 02 20:04:09.085784 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.085544 2568 scope.go:117] "RemoveContainer" containerID="2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69" Jul 02 20:04:09.095290 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.095270 2568 scope.go:117] "RemoveContainer" containerID="2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69" Jul 02 20:04:09.095516 ip-10-0-139-102 kubenswrapper[2568]: E0702 20:04:09.095497 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69\": container with ID starting with 2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69 not found: ID does not exist" containerID="2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69" Jul 02 20:04:09.095566 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.095525 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69"} err="failed to get container status \"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69\": rpc error: code = NotFound desc = could not find container \"2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69\": container with ID starting with 2da695ce913e4e5c8fb32366d45a379756eb60517731f0ed9714fb4b73020d69 not found: ID does not exist" Jul 02 20:04:09.108076 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.108054 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:04:09.110175 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:09.110149 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d959ff4bc-lgbbm"] Jul 02 20:04:10.397157 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:10.397123 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="defcfcab-ffb1-4203-8b69-4381d82c703b" path="/var/lib/kubelet/pods/defcfcab-ffb1-4203-8b69-4381d82c703b/volumes" Jul 02 20:04:50.326728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:50.326699 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:04:50.338175 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:04:50.332197 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:09:50.366468 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:09:50.366394 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:09:50.369533 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:09:50.369514 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:14:16.399442 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:16.399338 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f96bb8557-t7kcj_342c2d23-7517-4288-acd2-9d4bb9938fa2/authorino/0.log" Jul 02 20:14:19.652047 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:19.652014 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nt8hp_df2768fa-619b-42a9-aff9-dddb63f445cc/manager/0.log" Jul 02 20:14:19.769573 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:19.769543 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-74z4r_44265589-e81b-4289-a5fa-c59f543cb685/manager/0.log" Jul 02 20:14:20.011738 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:20.011653 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lk762_c5935b9a-46e2-4df2-8621-df7fe1860d50/server/0.log" Jul 02 20:14:20.390056 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:20.390014 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk_7aeca63a-3440-4c14-addb-070ca8fa8d20/manager/0.log" Jul 02 20:14:20.396808 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:20.396777 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk_7aeca63a-3440-4c14-addb-070ca8fa8d20/copy-manifests/0.log" Jul 02 20:14:20.646914 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:20.646809 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7xdks_c43be586-1f43-4bcf-bda8-4da94a362181/postgres/0.log" Jul 02 20:14:21.435455 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.435427 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/util/0.log" Jul 02 20:14:21.442364 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.442326 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/pull/0.log" Jul 02 20:14:21.448823 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.448804 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/extract/0.log" Jul 02 20:14:21.565805 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.565774 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/util/0.log" Jul 02 20:14:21.572967 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.572942 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/pull/0.log" Jul 02 20:14:21.580325 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.580304 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/extract/0.log" Jul 02 20:14:21.692978 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.692903 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/util/0.log" Jul 02 20:14:21.699802 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.699779 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/pull/0.log" Jul 02 20:14:21.706451 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.706431 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/extract/0.log" Jul 02 20:14:21.826292 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.826261 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/util/0.log" Jul 02 20:14:21.832967 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.832943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/pull/0.log" Jul 02 20:14:21.839392 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.839375 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/extract/0.log" Jul 02 20:14:21.951586 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:21.951508 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f96bb8557-t7kcj_342c2d23-7517-4288-acd2-9d4bb9938fa2/authorino/0.log" Jul 02 20:14:23.135891 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:23.135843 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf455frw_a3cd4fbd-308b-4068-bcfc-5f7f72322486/istio-proxy/0.log" Jul 02 20:14:23.602399 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:23.602307 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r92ns_5894ab32-c564-4a96-afbc-e7bc4b46be7d/istio-proxy/0.log" Jul 02 20:14:23.718733 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:23.718702 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d9b775df-jr9dz_62495e0c-c93f-4616-a7fe-594cf7ab9098/router/0.log" Jul 02 20:14:28.343540 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.343509 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f2cpm/must-gather-f4m8j"] Jul 02 20:14:28.344012 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.343856 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="defcfcab-ffb1-4203-8b69-4381d82c703b" containerName="manager" Jul 02 20:14:28.344012 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.343867 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="defcfcab-ffb1-4203-8b69-4381d82c703b" containerName="manager" Jul 02 20:14:28.344012 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.343957 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="defcfcab-ffb1-4203-8b69-4381d82c703b" containerName="manager" Jul 02 20:14:28.347113 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.347096 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.349893 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.349859 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2cpm\"/\"kube-root-ca.crt\"" Jul 02 20:14:28.350861 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.350845 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-f2cpm\"/\"openshift-service-ca.crt\"" Jul 02 20:14:28.350975 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.350871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-f2cpm\"/\"default-dockercfg-8gtzc\"" Jul 02 20:14:28.369969 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.369934 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2cpm/must-gather-f4m8j"] Jul 02 20:14:28.505491 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.505457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884eb19c-753d-4ada-84f7-832f36c223d1-must-gather-output\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.505656 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.505502 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6jz6g\" (UniqueName: \"kubernetes.io/projected/884eb19c-753d-4ada-84f7-832f36c223d1-kube-api-access-6jz6g\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.606429 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.606351 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884eb19c-753d-4ada-84f7-832f36c223d1-must-gather-output\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.606429 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.606400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6jz6g\" (UniqueName: \"kubernetes.io/projected/884eb19c-753d-4ada-84f7-832f36c223d1-kube-api-access-6jz6g\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.606675 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.606655 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/884eb19c-753d-4ada-84f7-832f36c223d1-must-gather-output\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.617098 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.617074 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6jz6g\" (UniqueName: \"kubernetes.io/projected/884eb19c-753d-4ada-84f7-832f36c223d1-kube-api-access-6jz6g\") pod \"must-gather-f4m8j\" (UID: \"884eb19c-753d-4ada-84f7-832f36c223d1\") " pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.655976 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.655951 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" Jul 02 20:14:28.786917 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.786860 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2cpm/must-gather-f4m8j"] Jul 02 20:14:28.788246 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:14:28.788208 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod884eb19c_753d_4ada_84f7_832f36c223d1.slice/crio-0eb00f72925d6af0828ff021a18585a08c9753e496eebe508566737c6514149e WatchSource:0}: Error finding container 0eb00f72925d6af0828ff021a18585a08c9753e496eebe508566737c6514149e: Status 404 returned error can't find the container with id 0eb00f72925d6af0828ff021a18585a08c9753e496eebe508566737c6514149e Jul 02 20:14:28.790192 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:28.790174 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 02 20:14:29.215927 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:29.215870 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" event={"ID":"884eb19c-753d-4ada-84f7-832f36c223d1","Type":"ContainerStarted","Data":"0eb00f72925d6af0828ff021a18585a08c9753e496eebe508566737c6514149e"} Jul 02 20:14:30.226008 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:30.225965 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" event={"ID":"884eb19c-753d-4ada-84f7-832f36c223d1","Type":"ContainerStarted","Data":"5ab5606de6cf96ba2731672982f302b754edb0ed6985bc877409b9ba1070c049"} Jul 02 20:14:30.226480 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:30.226031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" event={"ID":"884eb19c-753d-4ada-84f7-832f36c223d1","Type":"ContainerStarted","Data":"0180ec453088b7f2e4c13b730d9352cf449242b5d4f2dfb6912787b65054df78"} Jul 02 20:14:30.245514 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:30.245452 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f2cpm/must-gather-f4m8j" podStartSLOduration=1.222104017 podStartE2EDuration="2.245432022s" totalImagesPullingTime="1.023328005s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-02 20:14:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:30.244276411 +0000 UTC m=+1180.348427505" watchObservedRunningTime="2026-07-02 20:14:30.245432022 +0000 UTC m=+1180.349583116" Jul 02 20:14:31.386629 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:31.386598 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7p8d4_33862b5d-5eb7-44b6-936b-fb288c0368c2/global-pull-secret-syncer/0.log" Jul 02 20:14:31.559229 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:31.559194 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mlvml_89f43f81-c546-4f28-98f0-64793f0c07c5/konnectivity-agent/0.log" Jul 02 20:14:31.633491 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:31.633458 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-139-102.ec2.internal_086c074f33b6433127db8eae8b6a6580/haproxy/0.log" Jul 02 20:14:35.972095 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:35.972061 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/extract/0.log" Jul 02 20:14:35.998536 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:35.998503 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/util/0.log" Jul 02 20:14:36.027683 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.027634 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759pt7np_9bb43a72-5667-452e-b741-3f8fd2fecc5d/pull/0.log" Jul 02 20:14:36.099268 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.099212 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/extract/0.log" Jul 02 20:14:36.124296 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.124271 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/util/0.log" Jul 02 20:14:36.147327 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.147299 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e04kmdr_ffce9970-8e64-4a0a-9442-466a1b76319e/pull/0.log" Jul 02 20:14:36.175726 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.175656 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/extract/0.log" Jul 02 20:14:36.204241 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.204216 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/util/0.log" Jul 02 20:14:36.231805 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.231768 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed738ktjg_29fec5ba-ccfd-459f-8d55-a2b8347b78eb/pull/0.log" Jul 02 20:14:36.272045 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.272010 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/extract/0.log" Jul 02 20:14:36.290778 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.290746 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/util/0.log" Jul 02 20:14:36.311791 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.311752 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1cf4t5_62e7f3f7-5ffa-49e1-b8af-b17a074d3103/pull/0.log" Jul 02 20:14:36.350154 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:36.350123 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7f96bb8557-t7kcj_342c2d23-7517-4288-acd2-9d4bb9938fa2/authorino/0.log" Jul 02 20:14:38.415261 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:38.415232 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-n8lpg_6151ca11-7350-4009-a497-88256c0f6c00/cluster-monitoring-operator/0.log" Jul 02 20:14:38.776606 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:38.776529 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfx7t_0e63189a-ff9f-4f9d-847f-189b3b2de595/node-exporter/0.log" Jul 02 20:14:38.799111 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:38.799079 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfx7t_0e63189a-ff9f-4f9d-847f-189b3b2de595/kube-rbac-proxy/0.log" Jul 02 20:14:38.819519 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:38.819488 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-rfx7t_0e63189a-ff9f-4f9d-847f-189b3b2de595/init-textfile/0.log" Jul 02 20:14:39.183192 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:39.183161 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-d559d66d5-lrrqc_f8c04424-7231-4f2f-bd82-8a0a7221fd4d/prometheus-operator-admission-webhook/0.log" Jul 02 20:14:40.642187 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:40.642157 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-bq8jm_52a8bafe-c199-4538-82c2-723d0f335b13/networking-console-plugin/0.log" Jul 02 20:14:41.221776 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.221744 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:14:41.230547 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.230507 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/3.log" Jul 02 20:14:41.737035 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.737001 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-d8bc7dccc-bwnh6_085a65f8-5d7d-4e54-83b2-5536a0d6e02b/console/0.log" Jul 02 20:14:41.851193 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.851159 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7"] Jul 02 20:14:41.857368 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.857336 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:41.867460 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:41.867435 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7"] Jul 02 20:14:42.036009 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.035930 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-proc\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.036272 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.036253 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-lib-modules\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.036431 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.036396 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-podres\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.036570 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.036556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmppm\" (UniqueName: \"kubernetes.io/projected/f9e86374-a80b-442f-9a16-c894357ac204-kube-api-access-cmppm\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.036752 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.036740 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-sys\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138293 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138264 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-lib-modules\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138479 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138300 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-podres\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138479 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmppm\" (UniqueName: \"kubernetes.io/projected/f9e86374-a80b-442f-9a16-c894357ac204-kube-api-access-cmppm\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138479 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-sys\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138479 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138470 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-podres\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138659 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-proc\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138659 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138507 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-lib-modules\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138659 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138516 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-sys\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.138659 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.138588 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f9e86374-a80b-442f-9a16-c894357ac204-proc\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.147174 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.147153 2568 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmppm\" (UniqueName: \"kubernetes.io/projected/f9e86374-a80b-442f-9a16-c894357ac204-kube-api-access-cmppm\") pod \"perf-node-gather-daemonset-smqn7\" (UID: \"f9e86374-a80b-442f-9a16-c894357ac204\") " pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.173167 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.173131 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:42.346728 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.346703 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7"] Jul 02 20:14:42.348395 ip-10-0-139-102 kubenswrapper[2568]: W0702 20:14:42.348358 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf9e86374_a80b_442f_9a16_c894357ac204.slice/crio-8871f00a287e51c238a35283120ee341b26b704fa5b003bcee641503d2efa406 WatchSource:0}: Error finding container 8871f00a287e51c238a35283120ee341b26b704fa5b003bcee641503d2efa406: Status 404 returned error can't find the container with id 8871f00a287e51c238a35283120ee341b26b704fa5b003bcee641503d2efa406 Jul 02 20:14:42.420690 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:42.420663 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-t4b9v_1cf44374-b8fb-42af-813b-1fad0a76fdef/volume-data-source-validator/0.log" Jul 02 20:14:43.332578 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.332544 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" event={"ID":"f9e86374-a80b-442f-9a16-c894357ac204","Type":"ContainerStarted","Data":"639b0d38e0bf97e4a7007f33d33d71f7c6d77a2642e11ce3baa2264e9466f2ec"} Jul 02 20:14:43.332977 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.332695 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:43.332977 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.332724 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" event={"ID":"f9e86374-a80b-442f-9a16-c894357ac204","Type":"ContainerStarted","Data":"8871f00a287e51c238a35283120ee341b26b704fa5b003bcee641503d2efa406"} Jul 02 20:14:43.351040 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.350984 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" podStartSLOduration=2.350964991 podStartE2EDuration="2.350964991s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-02 20:14:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-02 20:14:43.347669857 +0000 UTC m=+1193.451820951" watchObservedRunningTime="2026-07-02 20:14:43.350964991 +0000 UTC m=+1193.455116084" Jul 02 20:14:43.498225 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.498180 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrpc4_cc756d5e-1e4d-4121-9a80-c0a8552478fe/dns/0.log" Jul 02 20:14:43.518782 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.518752 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mrpc4_cc756d5e-1e4d-4121-9a80-c0a8552478fe/kube-rbac-proxy/0.log" Jul 02 20:14:43.590851 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:43.590786 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9hgnj_c467b03d-d81a-462c-86fa-4fa553d71630/dns-node-resolver/0.log" Jul 02 20:14:44.221776 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:44.221740 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wpdsk_77202c31-ab05-48c8-a4d9-4903873af2b7/node-ca/0.log" Jul 02 20:14:45.158047 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:45.158018 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf455frw_a3cd4fbd-308b-4068-bcfc-5f7f72322486/istio-proxy/0.log" Jul 02 20:14:45.285240 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:45.285200 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r92ns_5894ab32-c564-4a96-afbc-e7bc4b46be7d/istio-proxy/0.log" Jul 02 20:14:45.312730 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:45.312696 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d9b775df-jr9dz_62495e0c-c93f-4616-a7fe-594cf7ab9098/router/0.log" Jul 02 20:14:45.909289 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:45.909251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5prcx_d34d91a8-f5dc-4fe5-ace6-45829ccac144/serve-healthcheck-canary/0.log" Jul 02 20:14:46.421431 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:46.421388 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-sn759_461340a3-9650-4d9d-9e84-e55eaee364be/insights-operator/0.log" Jul 02 20:14:46.422794 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:46.422764 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-sn759_461340a3-9650-4d9d-9e84-e55eaee364be/insights-operator/1.log" Jul 02 20:14:46.590810 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:46.590775 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz4hc_787455b8-80f7-4201-9dda-e3a2f5e78096/kube-rbac-proxy/0.log" Jul 02 20:14:46.613069 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:46.613041 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz4hc_787455b8-80f7-4201-9dda-e3a2f5e78096/exporter/0.log" Jul 02 20:14:46.639054 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:46.639026 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-jz4hc_787455b8-80f7-4201-9dda-e3a2f5e78096/extractor/0.log" Jul 02 20:14:48.762037 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:48.762006 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-nt8hp_df2768fa-619b-42a9-aff9-dddb63f445cc/manager/0.log" Jul 02 20:14:48.786326 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:48.786298 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-74z4r_44265589-e81b-4289-a5fa-c59f543cb685/manager/0.log" Jul 02 20:14:48.830825 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:48.830800 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-lk762_c5935b9a-46e2-4df2-8621-df7fe1860d50/server/0.log" Jul 02 20:14:48.943999 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:48.943969 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk_7aeca63a-3440-4c14-addb-070ca8fa8d20/manager/0.log" Jul 02 20:14:48.961955 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:48.961931 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5d5fdcb7fc-fd9jk_7aeca63a-3440-4c14-addb-070ca8fa8d20/copy-manifests/0.log" Jul 02 20:14:49.050917 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:49.050820 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-7xdks_c43be586-1f43-4bcf-bda8-4da94a362181/postgres/0.log" Jul 02 20:14:49.354505 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:49.354419 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-f2cpm/perf-node-gather-daemonset-smqn7" Jul 02 20:14:50.224440 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:50.224412 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-847997768d-8xk6b_7b27f789-6a17-42d9-a358-6797660aec4f/manager/0.log" Jul 02 20:14:50.454354 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:50.454321 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:14:50.455983 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:50.455946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-l9vwb_f3ca97ef-52b6-4db5-88e6-86162eefbb9a/console-operator/2.log" Jul 02 20:14:51.363399 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:51.363371 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf455frw_a3cd4fbd-308b-4068-bcfc-5f7f72322486/istio-proxy/0.log" Jul 02 20:14:51.438135 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:51.438096 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r92ns_5894ab32-c564-4a96-afbc-e7bc4b46be7d/istio-proxy/0.log" Jul 02 20:14:51.463841 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:51.463782 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d9b775df-jr9dz_62495e0c-c93f-4616-a7fe-594cf7ab9098/router/0.log" Jul 02 20:14:52.508771 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:52.508739 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf455frw_a3cd4fbd-308b-4068-bcfc-5f7f72322486/istio-proxy/0.log" Jul 02 20:14:52.595183 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:52.595151 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r92ns_5894ab32-c564-4a96-afbc-e7bc4b46be7d/istio-proxy/0.log" Jul 02 20:14:52.616896 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:52.616851 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-85d9b775df-jr9dz_62495e0c-c93f-4616-a7fe-594cf7ab9098/router/0.log" Jul 02 20:14:55.922494 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:55.922461 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7q4nd_c0e351b6-6ed5-4b60-b95f-8ec72d419991/kube-storage-version-migrator-operator/1.log" Jul 02 20:14:55.924765 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:55.924729 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-7q4nd_c0e351b6-6ed5-4b60-b95f-8ec72d419991/kube-storage-version-migrator-operator/0.log" Jul 02 20:14:56.948010 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:56.947983 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/kube-multus-additional-cni-plugins/0.log" Jul 02 20:14:56.967800 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:56.967775 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/egress-router-binary-copy/0.log" Jul 02 20:14:56.988322 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:56.988298 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/cni-plugins/0.log" Jul 02 20:14:57.007413 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.007390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/bond-cni-plugin/0.log" Jul 02 20:14:57.026348 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.026322 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/routeoverride-cni/0.log" Jul 02 20:14:57.045973 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.045943 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/whereabouts-cni-bincopy/0.log" Jul 02 20:14:57.068449 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.068420 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-clgx2_3a939587-2493-4373-a746-f3aa3311ffb0/whereabouts-cni/0.log" Jul 02 20:14:57.446670 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.446643 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-dkn4d_b0ceba08-a7bd-41b7-b73e-734f561d7853/kube-multus/0.log" Jul 02 20:14:57.509487 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.509437 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tnhmx_3ab9d5ec-c35c-404d-9dfa-d841531665b5/network-metrics-daemon/0.log" Jul 02 20:14:57.528482 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:57.528456 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-tnhmx_3ab9d5ec-c35c-404d-9dfa-d841531665b5/kube-rbac-proxy/0.log" Jul 02 20:14:58.567139 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.567104 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/ovn-controller/0.log" Jul 02 20:14:58.581418 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.581390 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/ovn-acl-logging/0.log" Jul 02 20:14:58.604043 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.604020 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/kube-rbac-proxy-node/0.log" Jul 02 20:14:58.623675 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.623647 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/kube-rbac-proxy-ovn-metrics/0.log" Jul 02 20:14:58.640727 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.640700 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/northd/0.log" Jul 02 20:14:58.659860 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.659830 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/nbdb/0.log" Jul 02 20:14:58.679855 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.679831 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/sbdb/0.log" Jul 02 20:14:58.745021 ip-10-0-139-102 kubenswrapper[2568]: I0702 20:14:58.744948 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-nn5g4_24d84617-286b-40c0-a763-ea79436791e6/ovnkube-controller/0.log"