Jun 09 11:42:36.907889 ip-10-0-128-244 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jun 09 11:42:36.907898 ip-10-0-128-244 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jun 09 11:42:36.907905 ip-10-0-128-244 systemd[1]: kubelet.service: Failed with result 'resources'. Jun 09 11:42:36.908054 ip-10-0-128-244 systemd[1]: Failed to start Kubernetes Kubelet. Jun 09 11:42:47.054661 ip-10-0-128-244 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jun 09 11:42:47.054679 ip-10-0-128-244 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot dc66030ef73d4a5dbe33f8c90a05fab2 -- Jun 09 11:45:20.803725 ip-10-0-128-244 systemd[1]: Starting Kubernetes Kubelet... Jun 09 11:45:21.194896 ip-10-0-128-244 kubenswrapper[2578]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:45:21.194896 ip-10-0-128-244 kubenswrapper[2578]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 09 11:45:21.194896 ip-10-0-128-244 kubenswrapper[2578]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:45:21.194896 ip-10-0-128-244 kubenswrapper[2578]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 09 11:45:21.194896 ip-10-0-128-244 kubenswrapper[2578]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 09 11:45:21.196455 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.196336 2578 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 09 11:45:21.201368 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201350 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.201368 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201366 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.201368 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201372 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201376 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201381 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201385 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201390 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201394 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201413 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201418 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201422 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201426 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201430 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201434 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201438 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201441 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201445 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201449 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201454 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201462 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201467 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.201570 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201471 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201475 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201479 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201483 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201487 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201491 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201495 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201502 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201508 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201512 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201519 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201524 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201529 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201534 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201538 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201544 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201549 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201554 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201559 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.202375 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201563 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201567 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201571 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201575 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201579 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201583 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201588 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201593 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201598 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201602 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201606 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201610 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201614 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201619 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201623 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201627 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201631 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201635 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201639 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201645 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.203193 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201649 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201653 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201657 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201662 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201667 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201672 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201677 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201681 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201685 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201689 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201694 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201700 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201704 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201708 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201713 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201717 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201721 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201726 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201730 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201734 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.203972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201738 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201742 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201748 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201752 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201757 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201762 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201766 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201772 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201777 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201782 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201787 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201791 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201796 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201800 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201805 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201808 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201813 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201817 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.201822 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.202987 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.204514 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.202996 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203001 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203006 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203010 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203015 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203020 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203024 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203028 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203033 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203037 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203041 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203045 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203050 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203054 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203058 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203062 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203066 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203071 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203075 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.205350 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203079 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203086 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203092 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203097 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203101 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203106 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203110 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203114 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203119 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203124 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203128 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203134 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203138 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203142 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203146 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203151 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203155 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203159 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203171 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.206201 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203176 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203180 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203184 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203188 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203192 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203196 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203200 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203204 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203208 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203212 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203220 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203226 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203231 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203235 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203240 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203244 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203249 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203254 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203258 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.207029 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203262 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203266 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203271 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203275 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203280 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203284 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203287 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203291 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203295 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203299 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203303 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203306 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203310 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203315 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203319 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203323 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203327 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203333 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203338 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.207523 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203342 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203347 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203350 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203355 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203358 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203362 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203367 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203371 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203375 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203379 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203383 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203388 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203392 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203396 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203417 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203421 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203430 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203434 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203439 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203443 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.208076 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203447 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.203452 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204922 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204934 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204939 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204944 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204950 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204955 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204959 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204963 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204968 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204972 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204976 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204980 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204985 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204989 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204994 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.204998 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205002 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205006 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.208816 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205010 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205014 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205019 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205022 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205026 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205031 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205035 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205039 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205044 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205048 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205053 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205058 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205062 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205066 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205070 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205074 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205079 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205083 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205087 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205093 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.209312 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205097 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205101 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205110 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205116 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205121 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205125 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205130 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205137 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205141 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205145 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205149 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205153 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205158 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205162 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205166 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205170 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205174 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205179 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205185 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.209919 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205191 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205197 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205201 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205206 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205210 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205214 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205218 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205222 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205226 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205230 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205235 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205239 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205243 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205248 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205252 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205256 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205262 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205266 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205270 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205274 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.210387 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205283 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205288 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205292 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205296 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205301 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205305 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205309 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205313 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205318 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205323 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205329 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205335 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205339 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205343 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205347 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205351 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205355 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205359 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205363 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205367 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.210897 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205372 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.205376 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205488 2578 flags.go:64] FLAG: --address="0.0.0.0" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205499 2578 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205509 2578 flags.go:64] FLAG: --anonymous-auth="true" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205516 2578 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205523 2578 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205529 2578 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205535 2578 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205541 2578 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205547 2578 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205552 2578 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205559 2578 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205566 2578 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205571 2578 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205576 2578 flags.go:64] FLAG: --cgroup-root="" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205581 2578 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205586 2578 flags.go:64] FLAG: --client-ca-file="" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205590 2578 flags.go:64] FLAG: --cloud-provider="external" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205595 2578 flags.go:64] FLAG: --cluster-dns="[]" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205601 2578 flags.go:64] FLAG: --cluster-domain="" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205605 2578 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205611 2578 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205615 2578 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 09 11:45:21.211421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205621 2578 flags.go:64] FLAG: --container-log-max-files="5" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205628 2578 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205632 2578 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205637 2578 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205642 2578 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205647 2578 flags.go:64] FLAG: --contention-profiling="false" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205651 2578 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205657 2578 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205662 2578 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205666 2578 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205672 2578 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205677 2578 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205681 2578 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205686 2578 flags.go:64] FLAG: --enable-load-reader="false" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205691 2578 flags.go:64] FLAG: --enable-server="true" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205696 2578 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205703 2578 flags.go:64] FLAG: --event-burst="100" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205708 2578 flags.go:64] FLAG: --event-qps="50" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205712 2578 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205717 2578 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205724 2578 flags.go:64] FLAG: --eviction-hard="" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205729 2578 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205734 2578 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205738 2578 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205744 2578 flags.go:64] FLAG: --eviction-soft="" Jun 09 11:45:21.212024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205748 2578 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205753 2578 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205757 2578 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205762 2578 flags.go:64] FLAG: --experimental-mounter-path="" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205769 2578 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205773 2578 flags.go:64] FLAG: --fail-swap-on="true" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205778 2578 flags.go:64] FLAG: --feature-gates="" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205785 2578 flags.go:64] FLAG: --file-check-frequency="20s" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205790 2578 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205795 2578 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205800 2578 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205805 2578 flags.go:64] FLAG: --healthz-port="10248" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205809 2578 flags.go:64] FLAG: --help="false" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205814 2578 flags.go:64] FLAG: --hostname-override="ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205819 2578 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205824 2578 flags.go:64] FLAG: --http-check-frequency="20s" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205829 2578 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205834 2578 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205840 2578 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205844 2578 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205849 2578 flags.go:64] FLAG: --image-service-endpoint="" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205853 2578 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205858 2578 flags.go:64] FLAG: --kube-api-burst="100" Jun 09 11:45:21.212748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205864 2578 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205869 2578 flags.go:64] FLAG: --kube-api-qps="50" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205874 2578 flags.go:64] FLAG: --kube-reserved="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205879 2578 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205885 2578 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205890 2578 flags.go:64] FLAG: --kubelet-cgroups="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205895 2578 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205900 2578 flags.go:64] FLAG: --lock-file="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205904 2578 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205909 2578 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205913 2578 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205922 2578 flags.go:64] FLAG: --log-json-split-stream="false" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205927 2578 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205933 2578 flags.go:64] FLAG: --log-text-split-stream="false" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205938 2578 flags.go:64] FLAG: --logging-format="text" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205943 2578 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205948 2578 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205952 2578 flags.go:64] FLAG: --manifest-url="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205957 2578 flags.go:64] FLAG: --manifest-url-header="" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205964 2578 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205969 2578 flags.go:64] FLAG: --max-open-files="1000000" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205975 2578 flags.go:64] FLAG: --max-pods="110" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205980 2578 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.205984 2578 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206008 2578 flags.go:64] FLAG: --memory-manager-policy="None" Jun 09 11:45:21.213346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206015 2578 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206021 2578 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206026 2578 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206031 2578 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206048 2578 flags.go:64] FLAG: --node-status-max-images="50" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206053 2578 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206058 2578 flags.go:64] FLAG: --oom-score-adj="-999" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206063 2578 flags.go:64] FLAG: --pod-cidr="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206069 2578 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:746976bfb3a92b93dacc79c151b98fd4c932eef19c3e2c1516b14eebcac9184d" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206076 2578 flags.go:64] FLAG: --pod-manifest-path="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206081 2578 flags.go:64] FLAG: --pod-max-pids="-1" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206089 2578 flags.go:64] FLAG: --pods-per-core="0" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206094 2578 flags.go:64] FLAG: --port="10250" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206099 2578 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206104 2578 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0aca8c3f3d26fc3ac" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206109 2578 flags.go:64] FLAG: --qos-reserved="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206114 2578 flags.go:64] FLAG: --read-only-port="10255" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206119 2578 flags.go:64] FLAG: --register-node="true" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206123 2578 flags.go:64] FLAG: --register-with-taints="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206130 2578 flags.go:64] FLAG: --registry-burst="10" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206134 2578 flags.go:64] FLAG: --registry-qps="5" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206141 2578 flags.go:64] FLAG: --reserved-cpus="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206146 2578 flags.go:64] FLAG: --reserved-memory="" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206152 2578 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206156 2578 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 09 11:45:21.213982 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206161 2578 flags.go:64] FLAG: --rotate-certificates="false" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206166 2578 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206171 2578 flags.go:64] FLAG: --runonce="false" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206175 2578 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206181 2578 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206185 2578 flags.go:64] FLAG: --seccomp-default="false" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206190 2578 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206195 2578 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206200 2578 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206204 2578 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206209 2578 flags.go:64] FLAG: --storage-driver-password="root" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206213 2578 flags.go:64] FLAG: --storage-driver-secure="false" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206217 2578 flags.go:64] FLAG: --storage-driver-table="stats" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206222 2578 flags.go:64] FLAG: --storage-driver-user="root" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206227 2578 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206232 2578 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206238 2578 flags.go:64] FLAG: --system-cgroups="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206242 2578 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206252 2578 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206256 2578 flags.go:64] FLAG: --tls-cert-file="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206261 2578 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206266 2578 flags.go:64] FLAG: --tls-min-version="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206270 2578 flags.go:64] FLAG: --tls-private-key-file="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206275 2578 flags.go:64] FLAG: --topology-manager-policy="none" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206280 2578 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 09 11:45:21.214615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206285 2578 flags.go:64] FLAG: --topology-manager-scope="container" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206290 2578 flags.go:64] FLAG: --v="2" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206296 2578 flags.go:64] FLAG: --version="false" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206304 2578 flags.go:64] FLAG: --vmodule="" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206310 2578 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.206315 2578 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206504 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206513 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206520 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206524 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206529 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206533 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206538 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206544 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206550 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206556 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206561 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206565 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206570 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206575 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206579 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.215224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206583 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206587 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206591 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206596 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206601 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206606 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206610 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206615 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206619 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206623 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206627 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206631 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206635 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206639 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206647 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206651 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206655 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206660 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206664 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206668 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.215762 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206672 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206677 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206681 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206685 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206690 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206694 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206698 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206702 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206706 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206710 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206715 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206719 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206725 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206731 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206735 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206740 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206745 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206749 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206753 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206757 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.216279 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206762 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206766 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206770 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206774 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206778 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206783 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206789 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206795 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206799 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206804 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206808 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206813 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206817 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206821 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206826 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206830 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206834 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206838 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206842 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206846 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.216793 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206850 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206855 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206859 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206864 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206868 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206872 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206876 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206880 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206884 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206889 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206894 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206898 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206902 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206906 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206911 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206915 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206919 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206926 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206933 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.217283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206939 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206944 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206949 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206953 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.206957 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.207680 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.214352 2578 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.214366 2578 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.214384 2578 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.214389 2578 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214455 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214460 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214463 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214466 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214469 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.217764 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214472 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214476 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214480 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214484 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214487 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214490 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214492 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214496 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214499 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214502 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214505 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214508 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214511 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214514 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214517 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214520 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214522 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214525 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214528 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.218130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214530 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214533 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214536 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214538 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214541 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214544 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214547 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214550 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214553 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214555 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214558 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214561 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214563 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214566 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214570 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214574 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214576 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214579 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214582 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214584 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.218613 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214587 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214590 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214592 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214595 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214598 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214600 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214603 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214605 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214608 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214611 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214613 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214616 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214619 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214621 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214624 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214627 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214630 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214633 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214636 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214638 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.219103 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214641 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214644 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214647 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214649 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214652 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214656 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214659 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214662 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214665 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214668 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214671 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214674 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214677 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214680 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214683 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214685 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214688 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214691 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214694 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.219688 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214696 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214699 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214701 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214704 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214707 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214710 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214712 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214715 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214717 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214720 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214723 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214726 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214728 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214731 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214734 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.220157 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214736 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.214741 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214845 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214849 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214852 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214855 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214858 2578 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214860 2578 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214863 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214866 2578 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214868 2578 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214871 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214873 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214877 2578 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214879 2578 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 09 11:45:21.220545 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214882 2578 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214884 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214887 2578 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214890 2578 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214892 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214895 2578 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214897 2578 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214900 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214902 2578 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214905 2578 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214908 2578 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214910 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214912 2578 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214915 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214918 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214920 2578 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214923 2578 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214926 2578 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214928 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 09 11:45:21.220913 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214931 2578 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214935 2578 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214938 2578 feature_gate.go:328] unrecognized feature gate: Example Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214941 2578 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214943 2578 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214946 2578 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214949 2578 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214951 2578 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214954 2578 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214956 2578 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214959 2578 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214962 2578 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214966 2578 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214969 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214972 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214975 2578 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214978 2578 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214981 2578 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214983 2578 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214986 2578 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 09 11:45:21.221367 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214989 2578 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214992 2578 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214994 2578 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.214997 2578 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215001 2578 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215004 2578 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215007 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215010 2578 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215012 2578 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215015 2578 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215018 2578 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215020 2578 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215023 2578 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215025 2578 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215028 2578 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215030 2578 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215033 2578 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215035 2578 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215038 2578 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215040 2578 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 09 11:45:21.222247 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215043 2578 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215045 2578 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215048 2578 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215051 2578 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215053 2578 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215056 2578 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215059 2578 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215061 2578 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215064 2578 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215066 2578 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215069 2578 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215071 2578 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215074 2578 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215077 2578 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215079 2578 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215083 2578 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215086 2578 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215089 2578 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215092 2578 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 09 11:45:21.222977 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215095 2578 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215097 2578 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215100 2578 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215103 2578 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215106 2578 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215108 2578 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215111 2578 feature_gate.go:328] unrecognized feature gate: Example2 Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:21.215113 2578 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.215118 2578 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.215206 2578 server.go:962] "Client rotation is on, will bootstrap in background" Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.217137 2578 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.218590 2578 server.go:1019] "Starting client certificate rotation" Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.218688 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:45:21.223463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.218736 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 09 11:45:21.223810 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.220979 2578 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:45:21.225139 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.225121 2578 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 09 11:45:21.236263 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.236244 2578 log.go:25] "Validated CRI v1 runtime API" Jun 09 11:45:21.238756 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.238740 2578 log.go:25] "Validated CRI v1 image API" Jun 09 11:45:21.239605 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.239589 2578 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 09 11:45:21.242938 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.242920 2578 fs.go:135] Filesystem UUIDs: map[27bbd170-2983-4436-b955-1e37183e623f:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 a5a7c520-036e-43a3-9974-4deaf7feadea:/dev/nvme0n1p4] Jun 09 11:45:21.242998 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.242938 2578 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 09 11:45:21.246441 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.246425 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:45:21.247959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.247727 2578 manager.go:216] Machine: {Timestamp:2026-06-09 11:45:21.246504463 +0000 UTC m=+0.327010444 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3128403 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec26dabb8ee349e13b52723146f4db94 SystemUUID:ec26dabb-8ee3-49e1-3b52-723146f4db94 BootID:dc66030e-f73d-4a5d-be33-f8c90a05fab2 Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e4:8e:37:9f:95 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e4:8e:37:9f:95 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:f6:3a:01:a3:7b:4a Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 09 11:45:21.247959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.247959 2578 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 09 11:45:21.248062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.248034 2578 manager.go:232] Version: {KernelVersion:5.14.0-570.118.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260602-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 09 11:45:21.251144 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.251120 2578 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 09 11:45:21.251268 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.251147 2578 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-244.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 09 11:45:21.251889 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.251879 2578 topology_manager.go:138] "Creating topology manager with none policy" Jun 09 11:45:21.251921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.251891 2578 container_manager_linux.go:309] "Creating device plugin manager" Jun 09 11:45:21.251921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.251899 2578 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:45:21.252441 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.252431 2578 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 09 11:45:21.253233 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.253223 2578 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 09 11:45:21.256235 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256223 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:45:21.256349 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256340 2578 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 09 11:45:21.256382 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256369 2578 kubelet.go:486] "Attempting to sync node with API server" Jun 09 11:45:21.256429 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256381 2578 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 09 11:45:21.256429 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256420 2578 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 09 11:45:21.256482 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256431 2578 kubelet.go:398] "Adding apiserver pod source" Jun 09 11:45:21.256482 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256440 2578 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 09 11:45:21.256830 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256818 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:45:21.256938 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.256859 2578 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 09 11:45:21.259138 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.259118 2578 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 09 11:45:21.260515 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.260499 2578 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 09 11:45:21.260587 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.260530 2578 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 09 11:45:21.261565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261552 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 09 11:45:21.261565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261568 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261574 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261580 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261589 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261595 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261603 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261609 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261615 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261620 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261629 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 09 11:45:21.261665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.261634 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 09 11:45:21.262265 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.262252 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 09 11:45:21.262299 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.262269 2578 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 09 11:45:21.265889 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.265866 2578 server.go:1268] "Started kubelet" Jun 09 11:45:21.266266 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.266236 2578 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 09 11:45:21.266354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.266282 2578 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 09 11:45:21.266354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.266348 2578 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 09 11:45:21.266957 ip-10-0-128-244 systemd[1]: Started Kubernetes Kubelet. Jun 09 11:45:21.267309 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.267067 2578 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-244.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 09 11:45:21.267935 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.267908 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 09 11:45:21.267998 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.267964 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 09 11:45:21.268144 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.268053 2578 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 09 11:45:21.269075 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.269061 2578 server.go:310] "Adding debug handlers to kubelet server" Jun 09 11:45:21.273623 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.273599 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjgdz" Jun 09 11:45:21.274834 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.273924 2578 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-244.ec2.internal.18b76715de0f0be6 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-244.ec2.internal,UID:ip-10-0-128-244.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-244.ec2.internal,},FirstTimestamp:2026-06-09 11:45:21.265822694 +0000 UTC m=+0.346328614,LastTimestamp:2026-06-09 11:45:21.265822694 +0000 UTC m=+0.346328614,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-244.ec2.internal,}" Jun 09 11:45:21.275687 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.275668 2578 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 09 11:45:21.276047 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276032 2578 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 09 11:45:21.276099 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276055 2578 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 09 11:45:21.276143 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.276120 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.276699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276625 2578 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 09 11:45:21.276699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276632 2578 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 09 11:45:21.276699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276642 2578 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 09 11:45:21.276860 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276721 2578 reconstruct.go:97] "Volume reconstruction finished" Jun 09 11:45:21.276860 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.276733 2578 reconciler.go:29] "Reconciler: start to sync state" Jun 09 11:45:21.277204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277125 2578 factory.go:55] Registering systemd factory Jun 09 11:45:21.277204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277144 2578 factory.go:223] Registration of the systemd container factory successfully Jun 09 11:45:21.277348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277335 2578 factory.go:153] Registering CRI-O factory Jun 09 11:45:21.277417 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277351 2578 factory.go:223] Registration of the crio container factory successfully Jun 09 11:45:21.277468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277417 2578 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 09 11:45:21.277468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277443 2578 factory.go:103] Registering Raw factory Jun 09 11:45:21.277468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277458 2578 manager.go:1196] Started watching for new ooms in manager Jun 09 11:45:21.277664 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.277643 2578 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-244.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 09 11:45:21.277825 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.277801 2578 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 09 11:45:21.277910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.277890 2578 manager.go:349] Starting recovery of all containers Jun 09 11:45:21.279103 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.279080 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tjgdz" Jun 09 11:45:21.288107 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.288093 2578 manager.go:354] Recovery completed Jun 09 11:45:21.289239 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.289214 2578 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory Jun 09 11:45:21.292036 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.292025 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.293717 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.293697 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.293798 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.293732 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.293798 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.293747 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.294264 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.294247 2578 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 09 11:45:21.294264 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.294263 2578 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 09 11:45:21.294360 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.294273 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.294360 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.294280 2578 state_mem.go:36] "Initialized new in-memory state store" Jun 09 11:45:21.295019 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295005 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.295076 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295028 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.295076 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295038 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.295413 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295390 2578 policy_none.go:49] "None policy: Start" Jun 09 11:45:21.295458 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295436 2578 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 09 11:45:21.295458 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.295451 2578 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 09 11:45:21.296463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.296452 2578 policy_none.go:47] "Start" Jun 09 11:45:21.334986 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.334971 2578 manager.go:337] "Starting Device Plugin manager" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.335003 2578 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335016 2578 server.go:87] "Starting device plugin registration server" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335319 2578 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335331 2578 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335444 2578 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335548 2578 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.335559 2578 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.336097 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.336208 2578 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.336249 2578 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.337536 2578 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.337562 2578 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.337579 2578 kubelet.go:2448] "Starting kubelet main sync loop" Jun 09 11:45:21.339084 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.337610 2578 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 09 11:45:21.339630 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.339610 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:21.435887 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.435867 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.436706 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.436692 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.436778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.436720 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.436778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.436729 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.436778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.436751 2578 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.437784 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.437769 2578 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal"] Jun 09 11:45:21.437833 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.437823 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.438540 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.438524 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.438606 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.438552 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.438606 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.438562 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.439703 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.439692 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.439840 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.439825 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.439899 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.439861 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.440718 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440702 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.440782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440725 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.440782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440727 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.440782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440764 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.440867 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440743 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.440867 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.440810 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.442136 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.442123 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.442177 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.442146 2578 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 09 11:45:21.442781 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.442768 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientMemory" Jun 09 11:45:21.442838 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.442797 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasNoDiskPressure" Jun 09 11:45:21.442838 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.442806 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeHasSufficientPID" Jun 09 11:45:21.444728 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.444715 2578 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.444788 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.444733 2578 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-244.ec2.internal\": node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.458891 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.458875 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.468027 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.468007 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-244.ec2.internal\" not found" node="ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.472536 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.472523 2578 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-244.ec2.internal\" not found" node="ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.477859 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.477840 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.477971 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.477871 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.477971 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.477894 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49eb15443a8878ff81426663865baab6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"49eb15443a8878ff81426663865baab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.559496 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.559465 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.578873 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.578851 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.578952 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.578878 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.578952 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.578926 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.578952 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.578944 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49eb15443a8878ff81426663865baab6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"49eb15443a8878ff81426663865baab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.579087 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.578983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49eb15443a8878ff81426663865baab6-config\") pod \"kube-apiserver-proxy-ip-10-0-128-244.ec2.internal\" (UID: \"49eb15443a8878ff81426663865baab6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.579087 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.579027 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/5226c078b7bfb28cf47145e120be8f4a-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal\" (UID: \"5226c078b7bfb28cf47145e120be8f4a\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.659997 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.659961 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.760786 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.760709 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.771876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.771854 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.777231 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:21.777216 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:21.861831 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.861799 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:21.962282 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:21.962251 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:22.062853 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:22.062786 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:22.162902 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:22.162882 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:22.164583 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.164565 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:22.217972 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.217948 2578 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 09 11:45:22.218383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.218082 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:45:22.218383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.218116 2578 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 09 11:45:22.263426 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:22.263392 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:22.269090 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:22.269065 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5226c078b7bfb28cf47145e120be8f4a.slice/crio-365d85cbeba39b8f8d713d2aca471c56a18f15309932a3971accdd64c3ba78b6 WatchSource:0}: Error finding container 365d85cbeba39b8f8d713d2aca471c56a18f15309932a3971accdd64c3ba78b6: Status 404 returned error can't find the container with id 365d85cbeba39b8f8d713d2aca471c56a18f15309932a3971accdd64c3ba78b6 Jun 09 11:45:22.269802 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:22.269782 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49eb15443a8878ff81426663865baab6.slice/crio-86342c3048c6318f2f4d0437ff99a951969d62a5cba03354dba2b63c67e2caab WatchSource:0}: Error finding container 86342c3048c6318f2f4d0437ff99a951969d62a5cba03354dba2b63c67e2caab: Status 404 returned error can't find the container with id 86342c3048c6318f2f4d0437ff99a951969d62a5cba03354dba2b63c67e2caab Jun 09 11:45:22.276223 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.276205 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:45:22.283063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.281422 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-08 11:40:21 +0000 UTC" deadline="2028-03-01 00:28:27.03588622 +0000 UTC" Jun 09 11:45:22.283063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.281458 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15132h43m4.754432706s" Jun 09 11:45:22.341757 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.341673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" event={"ID":"49eb15443a8878ff81426663865baab6","Type":"ContainerStarted","Data":"86342c3048c6318f2f4d0437ff99a951969d62a5cba03354dba2b63c67e2caab"} Jun 09 11:45:22.342721 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.342701 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"5226c078b7bfb28cf47145e120be8f4a","Type":"ContainerStarted","Data":"365d85cbeba39b8f8d713d2aca471c56a18f15309932a3971accdd64c3ba78b6"} Jun 09 11:45:22.363843 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:22.363822 2578 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-244.ec2.internal\" not found" Jun 09 11:45:22.434427 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.434393 2578 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:22.442014 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.441998 2578 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:22.476700 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.476679 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" Jun 09 11:45:22.489918 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.489898 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:45:22.491011 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.490999 2578 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" Jun 09 11:45:22.501285 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:22.501264 2578 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 09 11:45:23.258030 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.257999 2578 apiserver.go:52] "Watching apiserver" Jun 09 11:45:23.265007 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.264983 2578 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 09 11:45:23.265463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.265439 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-target-p2bbl","openshift-network-operator/iptables-alerter-qqbgd","openshift-ovn-kubernetes/ovnkube-node-898tr","kube-system/global-pull-secret-syncer-8xxbv","kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb","openshift-cluster-node-tuning-operator/tuned-lqsg7","openshift-dns/node-resolver-9fv2r","openshift-image-registry/node-ca-x2ml5","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal","openshift-multus/multus-pndrm","kube-system/konnectivity-agent-72pzm","openshift-multus/multus-additional-cni-plugins-dphf5","openshift-multus/network-metrics-daemon-wq7cp"] Jun 09 11:45:23.267025 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.267006 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.268135 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.268110 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.269297 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.269268 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-jvrgm\"" Jun 09 11:45:23.269414 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.269300 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.269414 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.269267 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.269414 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.269385 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.270136 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.270117 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.270588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.270567 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.270695 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.270677 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 09 11:45:23.270815 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.270796 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 09 11:45:23.270910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.270888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-2fl4v\"" Jun 09 11:45:23.271105 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.271086 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.271203 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.271180 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:23.271674 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.271630 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-nnx56\"" Jun 09 11:45:23.271916 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.271859 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 09 11:45:23.272005 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.271894 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 09 11:45:23.272115 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.272096 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.272169 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.272148 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:23.272221 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.272165 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 09 11:45:23.272489 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.272470 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.272575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.272500 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 09 11:45:23.272627 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.272569 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.274428 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.273682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.276215 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.276080 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.276295 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.276232 2578 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 09 11:45:23.277122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.276648 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-df7zn\"" Jun 09 11:45:23.277122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.277001 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 09 11:45:23.277122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.277031 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.278111 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.278037 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.279193 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.279164 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.279544 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.279523 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.280274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.280252 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.280361 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.280290 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bbbn7\"" Jun 09 11:45:23.280361 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.280321 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 09 11:45:23.281481 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.281461 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.281912 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.281886 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 09 11:45:23.282031 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.282010 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-98tf6\"" Jun 09 11:45:23.282131 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.282111 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 09 11:45:23.282930 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.282911 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.283832 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.283813 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 09 11:45:23.284243 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.284211 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-c488z\"" Jun 09 11:45:23.284331 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.284289 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.284392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.284220 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.284663 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.284649 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:23.284733 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.284712 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:23.285029 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.285012 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 09 11:45:23.285300 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.285285 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-xgtkz\"" Jun 09 11:45:23.285442 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.285374 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 09 11:45:23.286268 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.286251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.287865 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.287847 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.287967 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.287902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-conf-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.287967 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.287932 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-daemon-config\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.288062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.287967 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-etc-kubernetes\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.288062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.287995 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-kubernetes\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.288062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288021 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-systemd-units\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-slash\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288070 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-log-socket\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288094 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288118 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-cnibin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288153 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d9ksf\" (UniqueName: \"kubernetes.io/projected/b4c17869-8277-4de5-bf8e-f7c78f6e548b-kube-api-access-d9ksf\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.288213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288193 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-sys\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288218 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-lib-modules\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288255 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-etc-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-netd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/396faeea-35a2-4a9e-9df4-fadf363a70f3-host\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288349 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-os-release\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288375 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288412 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-var-lib-kubelet\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288434 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-ovn\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-dbus\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288499 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vj47l\" (UniqueName: \"kubernetes.io/projected/a82bef92-db54-4d30-9e34-77a4d58684a2-kube-api-access-vj47l\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.288552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288542 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cnibin\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288588 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288598 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-8wdml\"" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288594 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-twr2d\" (UniqueName: \"kubernetes.io/projected/30d71894-e0ef-424e-9b7f-269684708a4b-kube-api-access-twr2d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288653 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288680 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-kubelet-config\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288733 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288757 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-sys-fs\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-os-release\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288813 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288864 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-run\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288893 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-975qh\" (UniqueName: \"kubernetes.io/projected/396faeea-35a2-4a9e-9df4-fadf363a70f3-kube-api-access-975qh\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288917 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-system-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288939 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-multus\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.288988 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m99mc\" (UniqueName: \"kubernetes.io/projected/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kube-api-access-m99mc\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289043 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-system-cni-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289065 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysconfig\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-systemd\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289125 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-var-lib-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289148 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-cni-binary-copy\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289172 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-device-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289219 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-conf\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289261 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-node-log\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289288 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-socket-dir-parent\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289311 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-k8s-cni-cncf-io\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289336 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-socket-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-registration-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289463 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c42qt\" (UniqueName: \"kubernetes.io/projected/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-kube-api-access-c42qt\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289494 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-bin\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289532 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56276743-73aa-4f34-ba84-e27c624a2b2e-ovn-node-metrics-cert\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289559 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289575 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/396faeea-35a2-4a9e-9df4-fadf363a70f3-serviceca\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.289808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289590 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-tmp\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-script-lib\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289617 2578 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289690 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-kubelet\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289721 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-hostroot\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289743 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-host\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289802 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-kubelet\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-multus-certs\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-etc-tuned\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289902 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hx26w\" (UniqueName: \"kubernetes.io/projected/56276743-73aa-4f34-ba84-e27c624a2b2e-kube-api-access-hx26w\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.289970 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290062 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-netns\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290084 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290107 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-netns\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.290559 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290129 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-bin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.291378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-env-overrides\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.291378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290250 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-modprobe-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.291378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-systemd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.291378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.290293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-config\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.307635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.307617 2578 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-xmwpf" Jun 09 11:45:23.315074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.315049 2578 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-xmwpf" Jun 09 11:45:23.378072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.378050 2578 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 09 11:45:23.390806 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390783 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-multus-certs\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.390939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390817 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72875ed7-85a7-46a1-989a-ad83cc45942e-tmp-dir\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.390939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390860 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-etc-tuned\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.390939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390883 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.390939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390904 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hx26w\" (UniqueName: \"kubernetes.io/projected/56276743-73aa-4f34-ba84-e27c624a2b2e-kube-api-access-hx26w\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.390939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390928 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390880 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-multus-certs\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.390975 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391032 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391091 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-netns\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391152 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-netns\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391175 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-bin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391196 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391199 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391199 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-env-overrides\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391229 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d38238-873e-4e94-b5a0-cd2ca752fbde-konnectivity-ca\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-modprobe-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391231 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391262 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-bin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391270 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-systemd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391176 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-netns\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391295 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-config\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-systemd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391322 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391338 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-conf-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391346 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-netns\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-daemon-config\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-etc-kubernetes\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-kubernetes\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391423 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-systemd-units\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-modprobe-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.391588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391439 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-slash\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.391450 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-slash\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391469 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-log-socket\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391495 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391496 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391506 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-log-socket\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.391511 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:23.891492416 +0000 UTC m=+2.971998326 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391515 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391542 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-cnibin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391568 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d9ksf\" (UniqueName: \"kubernetes.io/projected/b4c17869-8277-4de5-bf8e-f7c78f6e548b-kube-api-access-d9ksf\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391593 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391614 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-sys\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391603 2578 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391635 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-env-overrides\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391640 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-lib-modules\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391715 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-lib-modules\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.392387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391718 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-etc-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391763 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-etc-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-netd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391793 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/396faeea-35a2-4a9e-9df4-fadf363a70f3-host\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391844 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-etc-selinux\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391998 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-daemon-config\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392003 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-os-release\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-sys\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391916 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-cnibin\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392035 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391952 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-systemd-units\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-netd\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-kubernetes\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391544 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-conf-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c8fln\" (UniqueName: \"kubernetes.io/projected/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-kube-api-access-c8fln\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391960 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-etc-kubernetes\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.391983 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/396faeea-35a2-4a9e-9df4-fadf363a70f3-host\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392040 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-config\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.393213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392104 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-var-lib-kubelet\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-ovn\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392155 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-var-lib-kubelet\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-os-release\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-dbus\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vj47l\" (UniqueName: \"kubernetes.io/projected/a82bef92-db54-4d30-9e34-77a4d58684a2-kube-api-access-vj47l\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cnibin\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392282 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-dbus\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-twr2d\" (UniqueName: \"kubernetes.io/projected/30d71894-e0ef-424e-9b7f-269684708a4b-kube-api-access-twr2d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392303 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cnibin\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-kubelet-config\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392348 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392372 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-sys-fs\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392194 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-run-ovn\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392395 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-os-release\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392456 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394073 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392479 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-run\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.392485 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-975qh\" (UniqueName: \"kubernetes.io/projected/396faeea-35a2-4a9e-9df4-fadf363a70f3-kube-api-access-975qh\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392528 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-system-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392539 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-run\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392529 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-sys-fs\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0973fe4e-b071-4133-856b-f62e31484959-kubelet-config\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.392560 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:23.892541221 +0000 UTC m=+2.973047129 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392586 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-multus\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392611 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m99mc\" (UniqueName: \"kubernetes.io/projected/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kube-api-access-m99mc\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392615 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-os-release\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392634 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-system-cni-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392665 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-iptables-alerter-script\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-cni-multus\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392693 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72875ed7-85a7-46a1-989a-ad83cc45942e-hosts-file\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392669 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-tuning-conf-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.394853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392720 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysconfig\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-system-cni-dir\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-system-cni-dir\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392752 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-systemd\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-var-lib-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392786 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysconfig\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392794 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-cni-binary-copy\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392805 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-cni-binary-copy\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392813 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-device-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392847 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-device-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392832 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-systemd\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392859 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-var-lib-openvswitch\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-conf\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392896 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-node-log\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392940 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-socket-dir-parent\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392954 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-conf\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392964 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-k8s-cni-cncf-io\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.395671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392977 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-node-log\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.392991 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-socket-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393016 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-registration-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393022 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-run-k8s-cni-cncf-io\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393041 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c42qt\" (UniqueName: \"kubernetes.io/projected/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-kube-api-access-c42qt\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393066 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-bin\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-registration-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393098 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393109 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-socket-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393015 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-multus-socket-dir-parent\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393129 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56276743-73aa-4f34-ba84-e27c624a2b2e-ovn-node-metrics-cert\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393155 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d38238-873e-4e94-b5a0-cd2ca752fbde-agent-certs\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393182 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-cni-bin\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393217 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/396faeea-35a2-4a9e-9df4-fadf363a70f3-serviceca\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393240 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a82bef92-db54-4d30-9e34-77a4d58684a2-cni-binary-copy\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393262 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-host-slash\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.396296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-tmp\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393346 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-script-lib\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393352 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-etc-sysctl-d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393370 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-kubelet\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-hostroot\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393433 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jzzj2\" (UniqueName: \"kubernetes.io/projected/72875ed7-85a7-46a1-989a-ad83cc45942e-kube-api-access-jzzj2\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393504 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-host\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393525 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-host-var-lib-kubelet\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-kubelet\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393558 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a82bef92-db54-4d30-9e34-77a4d58684a2-hostroot\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393580 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/56276743-73aa-4f34-ba84-e27c624a2b2e-host-kubelet\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393607 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kubelet-dir\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393670 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/30d71894-e0ef-424e-9b7f-269684708a4b-host\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.393691 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/396faeea-35a2-4a9e-9df4-fadf363a70f3-serviceca\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.394017 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/56276743-73aa-4f34-ba84-e27c624a2b2e-ovnkube-script-lib\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.395900 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-tmp\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.396010 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/30d71894-e0ef-424e-9b7f-269684708a4b-etc-tuned\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.396904 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.396158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/56276743-73aa-4f34-ba84-e27c624a2b2e-ovn-node-metrics-cert\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.404541 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.404520 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hx26w\" (UniqueName: \"kubernetes.io/projected/56276743-73aa-4f34-ba84-e27c624a2b2e-kube-api-access-hx26w\") pod \"ovnkube-node-898tr\" (UID: \"56276743-73aa-4f34-ba84-e27c624a2b2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.405136 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.405110 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d9ksf\" (UniqueName: \"kubernetes.io/projected/b4c17869-8277-4de5-bf8e-f7c78f6e548b-kube-api-access-d9ksf\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.406355 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.406335 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m99mc\" (UniqueName: \"kubernetes.io/projected/75f5c56c-fbe6-4b2d-92b0-a3888e7800ad-kube-api-access-m99mc\") pod \"aws-ebs-csi-driver-node-8kxwb\" (UID: \"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.406491 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.406463 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-975qh\" (UniqueName: \"kubernetes.io/projected/396faeea-35a2-4a9e-9df4-fadf363a70f3-kube-api-access-975qh\") pod \"node-ca-x2ml5\" (UID: \"396faeea-35a2-4a9e-9df4-fadf363a70f3\") " pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.406759 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.406721 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c42qt\" (UniqueName: \"kubernetes.io/projected/ab4b9db6-a1b0-4977-a0b1-b4da0299397c-kube-api-access-c42qt\") pod \"multus-additional-cni-plugins-dphf5\" (UID: \"ab4b9db6-a1b0-4977-a0b1-b4da0299397c\") " pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.406933 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.406910 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-twr2d\" (UniqueName: \"kubernetes.io/projected/30d71894-e0ef-424e-9b7f-269684708a4b-kube-api-access-twr2d\") pod \"tuned-lqsg7\" (UID: \"30d71894-e0ef-424e-9b7f-269684708a4b\") " pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.407114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.407097 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vj47l\" (UniqueName: \"kubernetes.io/projected/a82bef92-db54-4d30-9e34-77a4d58684a2-kube-api-access-vj47l\") pod \"multus-pndrm\" (UID: \"a82bef92-db54-4d30-9e34-77a4d58684a2\") " pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.494294 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c8fln\" (UniqueName: \"kubernetes.io/projected/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-kube-api-access-c8fln\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.494475 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494331 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-iptables-alerter-script\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.494475 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72875ed7-85a7-46a1-989a-ad83cc45942e-hosts-file\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.494475 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494388 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:23.494651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494506 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d38238-873e-4e94-b5a0-cd2ca752fbde-agent-certs\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.494651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-host-slash\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.494651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494545 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/72875ed7-85a7-46a1-989a-ad83cc45942e-hosts-file\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.494651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494566 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jzzj2\" (UniqueName: \"kubernetes.io/projected/72875ed7-85a7-46a1-989a-ad83cc45942e-kube-api-access-jzzj2\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.494651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494629 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-host-slash\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.494890 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72875ed7-85a7-46a1-989a-ad83cc45942e-tmp-dir\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.494890 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.494721 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d38238-873e-4e94-b5a0-cd2ca752fbde-konnectivity-ca\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.495377 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.495347 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/72875ed7-85a7-46a1-989a-ad83cc45942e-tmp-dir\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.496912 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.495872 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/32d38238-873e-4e94-b5a0-cd2ca752fbde-konnectivity-ca\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.498032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.497617 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/32d38238-873e-4e94-b5a0-cd2ca752fbde-agent-certs\") pod \"konnectivity-agent-72pzm\" (UID: \"32d38238-873e-4e94-b5a0-cd2ca752fbde\") " pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.498118 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.498101 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-iptables-alerter-script\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.500416 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.500383 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:23.500487 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.500420 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:23.500487 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.500431 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:23.500487 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.500483 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:24.000469292 +0000 UTC m=+3.080975218 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:23.502487 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.502467 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c8fln\" (UniqueName: \"kubernetes.io/projected/bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d-kube-api-access-c8fln\") pod \"iptables-alerter-qqbgd\" (UID: \"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d\") " pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.502881 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.502862 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jzzj2\" (UniqueName: \"kubernetes.io/projected/72875ed7-85a7-46a1-989a-ad83cc45942e-kube-api-access-jzzj2\") pod \"node-resolver-9fv2r\" (UID: \"72875ed7-85a7-46a1-989a-ad83cc45942e\") " pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.579864 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.579796 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" Jun 09 11:45:23.588590 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.588565 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-pndrm" Jun 09 11:45:23.598471 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.598453 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:23.601034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.601020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" Jun 09 11:45:23.607640 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.607623 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-x2ml5" Jun 09 11:45:23.614095 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.614082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-dphf5" Jun 09 11:45:23.621608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.621590 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-qqbgd" Jun 09 11:45:23.628197 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.628181 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-9fv2r" Jun 09 11:45:23.632938 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.632919 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:23.789118 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.789090 2578 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:23.897585 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.897500 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:23.897585 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:23.897551 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:23.897772 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.897675 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:23.897772 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.897752 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:24.897731237 +0000 UTC m=+3.978237148 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:23.897853 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.897677 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:23.897853 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:23.897832 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:24.897817038 +0000 UTC m=+3.978322943 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:24.099028 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.098990 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:24.099208 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.099186 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:24.099277 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.099217 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:24.099277 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.099233 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:24.099378 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.099297 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:25.099278233 +0000 UTC m=+4.179784158 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:24.153758 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.153731 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda82bef92_db54_4d30_9e34_77a4d58684a2.slice/crio-3e8772e762ba65ec8a5a8c0f317da04a5555e853943b94aeb256cc50cf419aaf WatchSource:0}: Error finding container 3e8772e762ba65ec8a5a8c0f317da04a5555e853943b94aeb256cc50cf419aaf: Status 404 returned error can't find the container with id 3e8772e762ba65ec8a5a8c0f317da04a5555e853943b94aeb256cc50cf419aaf Jun 09 11:45:24.155102 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.155079 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb8bf4e6_fb33_43e2_8ae1_d69e4a58c92d.slice/crio-fcbb21a9e12fc2bfbed76fe0b353b77e689f7c0568286318f4b8d647a20bb59c WatchSource:0}: Error finding container fcbb21a9e12fc2bfbed76fe0b353b77e689f7c0568286318f4b8d647a20bb59c: Status 404 returned error can't find the container with id fcbb21a9e12fc2bfbed76fe0b353b77e689f7c0568286318f4b8d647a20bb59c Jun 09 11:45:24.155742 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.155715 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56276743_73aa_4f34_ba84_e27c624a2b2e.slice/crio-727386d1ee1694ff2a1907f7b6a55d0f73b789c129af7775222602b0b914cadc WatchSource:0}: Error finding container 727386d1ee1694ff2a1907f7b6a55d0f73b789c129af7775222602b0b914cadc: Status 404 returned error can't find the container with id 727386d1ee1694ff2a1907f7b6a55d0f73b789c129af7775222602b0b914cadc Jun 09 11:45:24.159130 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.159109 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod396faeea_35a2_4a9e_9df4_fadf363a70f3.slice/crio-e0f5255773244f6df4731d3e78c3834cc99aee9e2db841e622eecab983e0ea8a WatchSource:0}: Error finding container e0f5255773244f6df4731d3e78c3834cc99aee9e2db841e622eecab983e0ea8a: Status 404 returned error can't find the container with id e0f5255773244f6df4731d3e78c3834cc99aee9e2db841e622eecab983e0ea8a Jun 09 11:45:24.160450 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.160428 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab4b9db6_a1b0_4977_a0b1_b4da0299397c.slice/crio-5360cb37265c03fda30b513758ba9b81354e424d69b450401afed6d7cad04222 WatchSource:0}: Error finding container 5360cb37265c03fda30b513758ba9b81354e424d69b450401afed6d7cad04222: Status 404 returned error can't find the container with id 5360cb37265c03fda30b513758ba9b81354e424d69b450401afed6d7cad04222 Jun 09 11:45:24.161119 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.161099 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32d38238_873e_4e94_b5a0_cd2ca752fbde.slice/crio-1231d5c9f8e81c93e218765e42d70c286bbefbbecfa9166db574f6707c83ecc8 WatchSource:0}: Error finding container 1231d5c9f8e81c93e218765e42d70c286bbefbbecfa9166db574f6707c83ecc8: Status 404 returned error can't find the container with id 1231d5c9f8e81c93e218765e42d70c286bbefbbecfa9166db574f6707c83ecc8 Jun 09 11:45:24.162702 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.162678 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72875ed7_85a7_46a1_989a_ad83cc45942e.slice/crio-348864360c10482fe5d68c3146d3cc06d04889d0ade513fd49e897d3966b0d8c WatchSource:0}: Error finding container 348864360c10482fe5d68c3146d3cc06d04889d0ade513fd49e897d3966b0d8c: Status 404 returned error can't find the container with id 348864360c10482fe5d68c3146d3cc06d04889d0ade513fd49e897d3966b0d8c Jun 09 11:45:24.163726 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.163466 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod75f5c56c_fbe6_4b2d_92b0_a3888e7800ad.slice/crio-e3a03339fe75e3c4557eeaeb57788aa30a40e6df1bbf3f1fc987e2a296089257 WatchSource:0}: Error finding container e3a03339fe75e3c4557eeaeb57788aa30a40e6df1bbf3f1fc987e2a296089257: Status 404 returned error can't find the container with id e3a03339fe75e3c4557eeaeb57788aa30a40e6df1bbf3f1fc987e2a296089257 Jun 09 11:45:24.164434 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:24.164247 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30d71894_e0ef_424e_9b7f_269684708a4b.slice/crio-5bb8c1763218c4a0d81ccfe29f6b3ae8734fb400691584723033937b1bc96e9f WatchSource:0}: Error finding container 5bb8c1763218c4a0d81ccfe29f6b3ae8734fb400691584723033937b1bc96e9f: Status 404 returned error can't find the container with id 5bb8c1763218c4a0d81ccfe29f6b3ae8734fb400691584723033937b1bc96e9f Jun 09 11:45:24.317501 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.317439 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:40:23 +0000 UTC" deadline="2027-11-11 21:29:35.651969038 +0000 UTC" Jun 09 11:45:24.317501 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.317501 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12489h44m11.334473877s" Jun 09 11:45:24.349512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.349478 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" event={"ID":"49eb15443a8878ff81426663865baab6","Type":"ContainerStarted","Data":"02f26c4fc939bbb08e1d795240d9e26ea38a57eb7b819d8b03cbeb46c74ef2f8"} Jun 09 11:45:24.350884 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.350851 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fv2r" event={"ID":"72875ed7-85a7-46a1-989a-ad83cc45942e","Type":"ContainerStarted","Data":"348864360c10482fe5d68c3146d3cc06d04889d0ade513fd49e897d3966b0d8c"} Jun 09 11:45:24.352117 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.352096 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerStarted","Data":"5360cb37265c03fda30b513758ba9b81354e424d69b450401afed6d7cad04222"} Jun 09 11:45:24.353160 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.353140 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72pzm" event={"ID":"32d38238-873e-4e94-b5a0-cd2ca752fbde","Type":"ContainerStarted","Data":"1231d5c9f8e81c93e218765e42d70c286bbefbbecfa9166db574f6707c83ecc8"} Jun 09 11:45:24.354336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.354317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"727386d1ee1694ff2a1907f7b6a55d0f73b789c129af7775222602b0b914cadc"} Jun 09 11:45:24.355254 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.355231 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qqbgd" event={"ID":"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d","Type":"ContainerStarted","Data":"fcbb21a9e12fc2bfbed76fe0b353b77e689f7c0568286318f4b8d647a20bb59c"} Jun 09 11:45:24.357277 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.357230 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" event={"ID":"30d71894-e0ef-424e-9b7f-269684708a4b","Type":"ContainerStarted","Data":"5bb8c1763218c4a0d81ccfe29f6b3ae8734fb400691584723033937b1bc96e9f"} Jun 09 11:45:24.359416 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.359386 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" event={"ID":"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad","Type":"ContainerStarted","Data":"e3a03339fe75e3c4557eeaeb57788aa30a40e6df1bbf3f1fc987e2a296089257"} Jun 09 11:45:24.360671 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.360649 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x2ml5" event={"ID":"396faeea-35a2-4a9e-9df4-fadf363a70f3","Type":"ContainerStarted","Data":"e0f5255773244f6df4731d3e78c3834cc99aee9e2db841e622eecab983e0ea8a"} Jun 09 11:45:24.362080 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.362058 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pndrm" event={"ID":"a82bef92-db54-4d30-9e34-77a4d58684a2","Type":"ContainerStarted","Data":"3e8772e762ba65ec8a5a8c0f317da04a5555e853943b94aeb256cc50cf419aaf"} Jun 09 11:45:24.362655 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.362578 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-244.ec2.internal" podStartSLOduration=2.362566801 podStartE2EDuration="2.362566801s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:24.36194851 +0000 UTC m=+3.442454459" watchObservedRunningTime="2026-06-09 11:45:24.362566801 +0000 UTC m=+3.443072727" Jun 09 11:45:24.905304 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.905271 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:24.905500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.905334 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:24.905500 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.905452 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:24.905624 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.905514 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:26.905495573 +0000 UTC m=+5.986001497 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:24.905624 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.905450 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:24.905624 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:24.905587 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:26.905569384 +0000 UTC m=+5.986075301 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:24.927792 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:24.927746 2578 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 09 11:45:25.106416 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.106357 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:25.106600 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.106527 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:25.106600 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.106546 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:25.106600 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.106558 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:25.106741 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.106613 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:27.106595328 +0000 UTC m=+6.187101233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:25.318261 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.318153 2578 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-08 11:40:23 +0000 UTC" deadline="2028-03-24 00:28:45.220994742 +0000 UTC" Jun 09 11:45:25.318261 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.318213 2578 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15684h43m19.902785099s" Jun 09 11:45:25.341117 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.341074 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:25.341262 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.341198 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:25.341614 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.341593 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:25.341705 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.341685 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:25.341780 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.341746 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:25.341836 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:25.341815 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:25.380392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.380359 2578 generic.go:356] "Generic (PLEG): container finished" podID="5226c078b7bfb28cf47145e120be8f4a" containerID="850ede4d7e59a980f9a693fef739e0cca3aaefb1de710fe520dcfaeff9509969" exitCode=0 Jun 09 11:45:25.381585 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:25.381490 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"5226c078b7bfb28cf47145e120be8f4a","Type":"ContainerDied","Data":"850ede4d7e59a980f9a693fef739e0cca3aaefb1de710fe520dcfaeff9509969"} Jun 09 11:45:26.396445 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:26.395857 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" event={"ID":"5226c078b7bfb28cf47145e120be8f4a","Type":"ContainerStarted","Data":"1dbcea9d65c6be09ce9db5467639ad3bc9cfe306e5157ea67c3d409be5824de7"} Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:26.919324 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:26.919379 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:26.919534 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:26.919594 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:30.919576305 +0000 UTC m=+10.000082227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:26.919972 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:26.920060 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:26.920024 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:30.920009286 +0000 UTC m=+10.000515207 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:27.121575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:27.121537 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:27.121752 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.121706 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:27.121752 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.121725 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:27.121752 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.121737 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:27.121903 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.121794 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:31.121777138 +0000 UTC m=+10.202283057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:27.338212 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:27.338109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:27.338366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:27.338109 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:27.338366 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.338249 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:27.338366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:27.338299 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:27.338542 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.338371 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:27.338542 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:27.338452 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:29.338446 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:29.338415 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:29.338871 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:29.338445 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:29.338871 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:29.338550 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:29.338871 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:29.338644 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:29.338871 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:29.338639 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:29.338871 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:29.338736 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:30.953876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:30.953832 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:30.954321 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:30.953898 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:30.954321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:30.953998 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:30.954321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:30.954073 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:38.954050417 +0000 UTC m=+18.034556345 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:30.954321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:30.953999 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:30.954321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:30.954172 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:38.954150095 +0000 UTC m=+18.034656017 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:31.155455 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:31.155415 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:31.155633 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.155548 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:31.155633 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.155573 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:31.155633 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.155586 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:31.155813 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.155650 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:39.155631042 +0000 UTC m=+18.236136950 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:31.339557 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:31.339481 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:31.339705 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.339598 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:31.339705 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:31.339630 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:31.339837 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.339724 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:31.339837 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:31.339768 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:31.339934 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:31.339913 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:33.338391 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:33.338359 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:33.338855 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:33.338363 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:33.338855 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:33.338497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:33.338855 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:33.338516 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:33.338855 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:33.338580 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:33.338855 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:33.338652 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:35.341509 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:35.341475 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:35.341928 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:35.341483 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:35.341928 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:35.341581 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:35.341928 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:35.341654 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:35.341928 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:35.341477 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:35.341928 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:35.341741 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:37.337986 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:37.337956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:37.338453 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:37.337956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:37.338453 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:37.338093 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:37.338453 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:37.337956 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:37.338453 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:37.338164 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:37.338453 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:37.338221 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:39.012016 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.011974 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:39.012563 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.012048 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:39.012563 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.012167 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:39.012563 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.012185 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:39.012563 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.012229 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:55.012214816 +0000 UTC m=+34.092720725 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:39.012563 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.012244 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:45:55.012237536 +0000 UTC m=+34.092743445 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:39.213480 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.213435 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:39.213658 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.213566 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:39.213658 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.213582 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:39.213658 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.213591 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:39.213658 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.213652 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:45:55.213633903 +0000 UTC m=+34.294139834 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:39.341072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.341004 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:39.341072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.341029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:39.341072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:39.341029 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:39.341276 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.341134 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:39.341276 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.341209 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:39.341340 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:39.341281 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:41.338647 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:41.338622 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:41.339190 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:41.338715 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:41.339190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:41.338813 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:41.339190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:41.338821 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:41.339190 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:41.338955 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:41.339190 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:41.339112 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:43.343318 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.343182 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:43.343665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.343230 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:43.343665 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.343270 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:43.343665 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:43.343555 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:43.343836 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:43.343684 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:43.343836 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:43.343776 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:43.432781 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.432727 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-72pzm" event={"ID":"32d38238-873e-4e94-b5a0-cd2ca752fbde","Type":"ContainerStarted","Data":"0441a635c60d225aaeacbdc93664df2e4d4d43f0f64526b498c2e82e4d462b7c"} Jun 09 11:45:43.435736 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.435711 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:45:43.436169 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.436143 2578 generic.go:356] "Generic (PLEG): container finished" podID="56276743-73aa-4f34-ba84-e27c624a2b2e" containerID="f61be3cd727fc19f10f6a49ae47e05755d29027e1c2375cbe09baa2692186e02" exitCode=1 Jun 09 11:45:43.436259 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.436222 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"e09513c0d3170aba716b56bfa6ce0eb350b5e5e42cb78e243fcfc72936f49ef0"} Jun 09 11:45:43.436331 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.436314 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerDied","Data":"f61be3cd727fc19f10f6a49ae47e05755d29027e1c2375cbe09baa2692186e02"} Jun 09 11:45:43.436392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.436379 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"8e6ba5f2e69eaff4d6d20e7898d11ef548069851af867ccb4f9f7a2e1644773b"} Jun 09 11:45:43.437843 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.437806 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" event={"ID":"30d71894-e0ef-424e-9b7f-269684708a4b","Type":"ContainerStarted","Data":"e07f9f5c53b916d52197af44af402616722a0833c9b7c23873b4511ee1f617ed"} Jun 09 11:45:43.439221 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.439201 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" event={"ID":"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad","Type":"ContainerStarted","Data":"1731fa7bca403c3d131d9020610c512aa09da82fcf6d061d8e67d9e7f73b3ebc"} Jun 09 11:45:43.440444 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.440428 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-x2ml5" event={"ID":"396faeea-35a2-4a9e-9df4-fadf363a70f3","Type":"ContainerStarted","Data":"e87bec60afef34b9e28cb46412b64a3458c8a74c30bf54dddf778bdb3e8233fb"} Jun 09 11:45:43.441806 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.441706 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-9fv2r" event={"ID":"72875ed7-85a7-46a1-989a-ad83cc45942e","Type":"ContainerStarted","Data":"8b10f15ac5432143d5948b06c9588018a080922d714e92318a6bc397f848ced0"} Jun 09 11:45:43.443265 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.443245 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="40e35b53eb1f99dfe2edd0e38e22faae2ba532cd37c12595781a16745e51fc1c" exitCode=0 Jun 09 11:45:43.443346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.443276 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"40e35b53eb1f99dfe2edd0e38e22faae2ba532cd37c12595781a16745e51fc1c"} Jun 09 11:45:43.446710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.446665 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-244.ec2.internal" podStartSLOduration=21.446649576 podStartE2EDuration="21.446649576s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:26.411955512 +0000 UTC m=+5.492461444" watchObservedRunningTime="2026-06-09 11:45:43.446649576 +0000 UTC m=+22.527155504" Jun 09 11:45:43.446876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.446848 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-72pzm" podStartSLOduration=12.443734727 podStartE2EDuration="22.446841212s" totalImagesPullingTime="10.003106485s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:43.446002133 +0000 UTC m=+22.526508058" watchObservedRunningTime="2026-06-09 11:45:43.446841212 +0000 UTC m=+22.527347140" Jun 09 11:45:43.458473 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.458441 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-x2ml5" podStartSLOduration=3.7302674749999998 podStartE2EDuration="22.458431182s" totalImagesPullingTime="18.728163707s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:43.458310038 +0000 UTC m=+22.538815985" watchObservedRunningTime="2026-06-09 11:45:43.458431182 +0000 UTC m=+22.538937106" Jun 09 11:45:43.474778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.474741 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-9fv2r" podStartSLOduration=4.124135869 podStartE2EDuration="22.47472813s" totalImagesPullingTime="18.350592261s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:43.47410489 +0000 UTC m=+22.554610816" watchObservedRunningTime="2026-06-09 11:45:43.47472813 +0000 UTC m=+22.555234056" Jun 09 11:45:43.493013 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:43.492974 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-lqsg7" podStartSLOduration=3.745597637 podStartE2EDuration="22.492961234s" totalImagesPullingTime="18.747363597s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:43.492529478 +0000 UTC m=+22.573035404" watchObservedRunningTime="2026-06-09 11:45:43.492961234 +0000 UTC m=+22.573467161" Jun 09 11:45:44.427632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.427417 2578 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 09 11:45:44.448856 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.448832 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:45:44.449295 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.449257 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"3453b3e9d7f8896365504dca9c583f3e3431cc641d22eaee17a35d1f3e4fef92"} Jun 09 11:45:44.449430 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.449395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"15f8b4bc527d9faece3e10ed7d723fcf3f5b6af070157844ff695a24fedd8024"} Jun 09 11:45:44.449549 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.449466 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"f776fd7c534336490beef822815714e1f3f38d4d69fc9b8d19e1ae71ed3af969"} Jun 09 11:45:44.450901 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.450867 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-qqbgd" event={"ID":"bb8bf4e6-fb33-43e2-8ae1-d69e4a58c92d","Type":"ContainerStarted","Data":"1a530a2ca946e5fe1f24cbcfe1582e441f30d49be4e8ab26de22221196fab27c"} Jun 09 11:45:44.452951 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.452928 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" event={"ID":"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad","Type":"ContainerStarted","Data":"fa538b2d6b0f64445a7b72cece3993491ea6bff3b56490fbf29085ac9884c877"} Jun 09 11:45:44.454673 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.454643 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-pndrm" event={"ID":"a82bef92-db54-4d30-9e34-77a4d58684a2","Type":"ContainerStarted","Data":"ca424405b9acbc039cebffaef0579a5c025e2cef060fa2579541a1f1443af0d9"} Jun 09 11:45:44.464012 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.463972 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-qqbgd" podStartSLOduration=5.1048664519999996 podStartE2EDuration="23.46395948s" totalImagesPullingTime="18.359093028s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:44.463759243 +0000 UTC m=+23.544265176" watchObservedRunningTime="2026-06-09 11:45:44.46395948 +0000 UTC m=+23.544465407" Jun 09 11:45:44.479395 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.479351 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-pndrm" podStartSLOduration=4.311729643 podStartE2EDuration="23.47933974s" totalImagesPullingTime="19.167610097s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:44.479039687 +0000 UTC m=+23.559545615" watchObservedRunningTime="2026-06-09 11:45:44.47933974 +0000 UTC m=+23.559845661" Jun 09 11:45:44.609893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.609788 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:44.683706 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.683665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:44.786567 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.786536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:44.842507 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:44.842466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:45.038788 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.038711 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:45.039519 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.039494 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:45.338710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.338631 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:45.338710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.338662 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:45.338925 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:45.338771 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:45.338925 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:45.338865 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:45.338925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.338925 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:45.339073 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:45.338992 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:45.348435 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.348312 2578 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-09T11:45:44.427607896Z","UUID":"817d61eb-ef3b-4dbd-bb29-579fba1b2cb3","Handler":null,"Name":"","Endpoint":""} Jun 09 11:45:45.350248 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.350224 2578 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 09 11:45:45.350387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.350272 2578 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 09 11:45:45.458622 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.458594 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:45.459057 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.459038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-72pzm" Jun 09 11:45:45.518533 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:45.518503 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:46.462910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:46.462878 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:45:46.463482 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:46.463329 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"8a499a185e27677441a76e4761af35caad3cc0c968f9e031b439c0a7436d6c34"} Jun 09 11:45:46.465719 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:46.465689 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" event={"ID":"75f5c56c-fbe6-4b2d-92b0-a3888e7800ad","Type":"ContainerStarted","Data":"eb10c10bbb9a6162f8ee06db48548cadf0d1d01a98d2cd4b75886345c9a7e957"} Jun 09 11:45:46.482267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:46.482220 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-8kxwb" podStartSLOduration=4.590881932 podStartE2EDuration="25.482205258s" totalImagesPullingTime="20.891323326s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:46.48125319 +0000 UTC m=+25.561759118" watchObservedRunningTime="2026-06-09 11:45:46.482205258 +0000 UTC m=+25.562711185" Jun 09 11:45:47.317774 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.317728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:47.337839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.337804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:47.337839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.337836 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:47.338068 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.337804 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:47.338068 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:47.337926 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:47.338068 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:47.338008 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:47.338232 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:47.338086 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:47.421202 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.421158 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:47.471611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:47.471579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:48.327324 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.327164 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:48.377418 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.377381 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:48.471794 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.471771 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="9d17d34d2df8c0064a23365a46d303652c10201e42c2a19cce855179dea2f5d9" exitCode=0 Jun 09 11:45:48.472200 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.471865 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"9d17d34d2df8c0064a23365a46d303652c10201e42c2a19cce855179dea2f5d9"} Jun 09 11:45:48.475607 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.475591 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:45:48.476033 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.476009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"80c5d8a09583e70c442961a9606761267fa2ff67916fbd930260232069f6fb6b"} Jun 09 11:45:48.476249 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.476230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:48.476322 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.476311 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:48.476608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.476353 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:48.476608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.476507 2578 scope.go:117] "RemoveContainer" containerID="f61be3cd727fc19f10f6a49ae47e05755d29027e1c2375cbe09baa2692186e02" Jun 09 11:45:48.491845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.491824 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:48.492824 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:48.492807 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:45:49.338787 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.338755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:49.338787 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.338775 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:49.339026 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.338761 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:49.339026 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.338867 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:49.339026 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.338918 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:49.339026 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.338991 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:49.482656 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.482628 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:45:49.483102 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.482931 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" event={"ID":"56276743-73aa-4f34-ba84-e27c624a2b2e","Type":"ContainerStarted","Data":"76554a08a7742ea4a566b035609b4f455aab8fae4f1f756ec45808dcd8513a2a"} Jun 09 11:45:49.510842 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.510785 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" podStartSLOduration=9.701556296 podStartE2EDuration="28.510767708s" totalImagesPullingTime="18.809211412s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:49.509701458 +0000 UTC m=+28.590207394" watchObservedRunningTime="2026-06-09 11:45:49.510767708 +0000 UTC m=+28.591273635" Jun 09 11:45:49.973226 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.973158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wq7cp"] Jun 09 11:45:49.973395 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.973321 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:49.973494 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.973465 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:49.974433 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.974383 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2bbl"] Jun 09 11:45:49.974551 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.974511 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:49.974616 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.974599 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:49.975036 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.975009 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8xxbv"] Jun 09 11:45:49.975113 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:49.975101 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:49.975195 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:49.975179 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:50.021636 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:50.021606 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:50.121129 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:50.121098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:50.181061 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:50.181034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:50.486851 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:50.486822 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="9bff66ffb2c684c818f5e85aa0b59988ff5d9dfdcac4f8975fa845f02698603d" exitCode=0 Jun 09 11:45:50.487343 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:50.486913 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"9bff66ffb2c684c818f5e85aa0b59988ff5d9dfdcac4f8975fa845f02698603d"} Jun 09 11:45:51.338869 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:51.338675 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:51.339044 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:51.338749 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:51.339044 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:51.338945 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:51.339157 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:51.339066 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:52.333552 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:52.333460 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:52.338543 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:52.338520 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:52.338659 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:52.338620 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:52.493960 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:52.493924 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="2ed68b73134ac87a3f5436d4886d43112c8a57d800c98eb6b482e6222530bfaa" exitCode=0 Jun 09 11:45:52.493960 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:52.493962 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"2ed68b73134ac87a3f5436d4886d43112c8a57d800c98eb6b482e6222530bfaa"} Jun 09 11:45:53.337992 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:53.337959 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:53.338430 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:53.338105 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:53.338430 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:53.338167 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:53.338430 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:53.338288 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:54.338289 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:54.338251 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:54.338754 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:54.338388 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8xxbv" podUID="0973fe4e-b071-4133-856b-f62e31484959" Jun 09 11:45:55.031357 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:55.031318 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:55.031550 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:55.031382 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:55.031550 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.031506 2578 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:55.031550 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.031537 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:55.031715 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.031582 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret podName:0973fe4e-b071-4133-856b-f62e31484959 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:27.031561801 +0000 UTC m=+66.112067712 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret") pod "global-pull-secret-syncer-8xxbv" (UID: "0973fe4e-b071-4133-856b-f62e31484959") : object "kube-system"/"original-pull-secret" not registered Jun 09 11:45:55.031715 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.031614 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:46:27.03159688 +0000 UTC m=+66.112102791 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 09 11:45:55.232735 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:55.232705 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:55.232898 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.232834 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 09 11:45:55.232898 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.232856 2578 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 09 11:45:55.232898 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.232867 2578 projected.go:196] Error preparing data for projected volume kube-api-access-dlggp for pod openshift-network-diagnostics/network-check-target-p2bbl: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:55.233110 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.232917 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp podName:c42b9278-8590-46b3-90bd-2bbe1304cd62 nodeName:}" failed. No retries permitted until 2026-06-09 11:46:27.232904498 +0000 UTC m=+66.313410403 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-dlggp" (UniqueName: "kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp") pod "network-check-target-p2bbl" (UID: "c42b9278-8590-46b3-90bd-2bbe1304cd62") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 09 11:45:55.338266 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:55.338189 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:55.338453 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.338316 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-p2bbl" podUID="c42b9278-8590-46b3-90bd-2bbe1304cd62" Jun 09 11:45:55.338453 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:55.338380 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:55.338885 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:55.338519 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:45:56.296723 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.296701 2578 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-244.ec2.internal" event="NodeReady" Jun 09 11:45:56.296878 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.296821 2578 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 09 11:45:56.338546 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.338512 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:45:56.340976 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.340948 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:45:56.341896 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.341877 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-5vf7n"] Jun 09 11:45:56.376314 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.376291 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-sj7nx"] Jun 09 11:45:56.376470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.376449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.378803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.378747 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 09 11:45:56.378803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.378767 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 09 11:45:56.378803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.378776 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6m6l\"" Jun 09 11:45:56.388896 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.388871 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5vf7n"] Jun 09 11:45:56.389012 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.388906 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sj7nx"] Jun 09 11:45:56.389012 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.389001 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.391518 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.391469 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 09 11:45:56.391518 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.391480 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 09 11:45:56.391518 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.391486 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 09 11:45:56.391723 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.391471 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-wjsls\"" Jun 09 11:45:56.428338 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.428312 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:56.442234 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.442208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c52b33d-e979-4e97-90fd-197a7d8739ca-tmp-dir\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.442348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.442249 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c52b33d-e979-4e97-90fd-197a7d8739ca-config-volume\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.442348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.442273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.442440 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.442345 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4dk7\" (UniqueName: \"kubernetes.io/projected/5c52b33d-e979-4e97-90fd-197a7d8739ca-kube-api-access-q4dk7\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.525749 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.525720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:56.543397 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e996d8a9-62a8-46c4-a678-2f471fd81ca6-cert\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.543503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543443 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29gq4\" (UniqueName: \"kubernetes.io/projected/e996d8a9-62a8-46c4-a678-2f471fd81ca6-kube-api-access-29gq4\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.543503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543464 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c52b33d-e979-4e97-90fd-197a7d8739ca-tmp-dir\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.543503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543487 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c52b33d-e979-4e97-90fd-197a7d8739ca-config-volume\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.543503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.543726 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:56.543618 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:45:56.543726 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543628 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4dk7\" (UniqueName: \"kubernetes.io/projected/5c52b33d-e979-4e97-90fd-197a7d8739ca-kube-api-access-q4dk7\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.543726 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:56.543660 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:45:57.043647609 +0000 UTC m=+36.124153515 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:45:56.543861 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.543790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5c52b33d-e979-4e97-90fd-197a7d8739ca-tmp-dir\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.544071 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.544056 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/5c52b33d-e979-4e97-90fd-197a7d8739ca-config-volume\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.553484 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.553443 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4dk7\" (UniqueName: \"kubernetes.io/projected/5c52b33d-e979-4e97-90fd-197a7d8739ca-kube-api-access-q4dk7\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:56.644570 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.644536 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29gq4\" (UniqueName: \"kubernetes.io/projected/e996d8a9-62a8-46c4-a678-2f471fd81ca6-kube-api-access-29gq4\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.644708 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.644601 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e996d8a9-62a8-46c4-a678-2f471fd81ca6-cert\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.647442 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.647392 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e996d8a9-62a8-46c4-a678-2f471fd81ca6-cert\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.653317 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.653294 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29gq4\" (UniqueName: \"kubernetes.io/projected/e996d8a9-62a8-46c4-a678-2f471fd81ca6-kube-api-access-29gq4\") pod \"ingress-canary-sj7nx\" (UID: \"e996d8a9-62a8-46c4-a678-2f471fd81ca6\") " pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.698775 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.698755 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-sj7nx" Jun 09 11:45:56.995903 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:56.995763 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-sj7nx"] Jun 09 11:45:56.999222 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:45:56.999200 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode996d8a9_62a8_46c4_a678_2f471fd81ca6.slice/crio-baff418736e25279c23b653b73c2c255c90b4a1ddda95f84a5365badf84062c5 WatchSource:0}: Error finding container baff418736e25279c23b653b73c2c255c90b4a1ddda95f84a5365badf84062c5: Status 404 returned error can't find the container with id baff418736e25279c23b653b73c2c255c90b4a1ddda95f84a5365badf84062c5 Jun 09 11:45:57.047439 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.047393 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:57.047555 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:57.047532 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:45:57.047627 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:57.047614 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:45:58.047592282 +0000 UTC m=+37.128098188 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:45:57.338609 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.338576 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:45:57.339202 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.338575 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:45:57.342590 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.342457 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:45:57.342590 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.342518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4spp\"" Jun 09 11:45:57.342590 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.342463 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t846k\"" Jun 09 11:45:57.342590 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.342566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:45:57.342803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.342566 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:45:57.506420 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.506369 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sj7nx" event={"ID":"e996d8a9-62a8-46c4-a678-2f471fd81ca6","Type":"ContainerStarted","Data":"baff418736e25279c23b653b73c2c255c90b4a1ddda95f84a5365badf84062c5"} Jun 09 11:45:57.509659 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.509631 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="b309de1a88bd68bc86ff14f6958d707e8b6033febd03510d11fc224520153c60" exitCode=0 Jun 09 11:45:57.509790 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:57.509671 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"b309de1a88bd68bc86ff14f6958d707e8b6033febd03510d11fc224520153c60"} Jun 09 11:45:58.053996 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:58.053922 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:45:58.054144 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:58.054039 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:45:58.054144 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:45:58.054093 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:46:00.05408012 +0000 UTC m=+39.134586025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:45:58.516209 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:58.516126 2578 generic.go:356] "Generic (PLEG): container finished" podID="ab4b9db6-a1b0-4977-a0b1-b4da0299397c" containerID="6b5886f1baab4d932312874740f402a6516daa92a0362df29ca38c5501c703ba" exitCode=0 Jun 09 11:45:58.516788 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:58.516208 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerDied","Data":"6b5886f1baab4d932312874740f402a6516daa92a0362df29ca38c5501c703ba"} Jun 09 11:45:59.520273 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.520083 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-sj7nx" event={"ID":"e996d8a9-62a8-46c4-a678-2f471fd81ca6","Type":"ContainerStarted","Data":"72f43da5a146d93144f2b5280d4b3135d4bc5ea9d2f6855f4849c46eb5ff8175"} Jun 09 11:45:59.523188 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.523162 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-dphf5" event={"ID":"ab4b9db6-a1b0-4977-a0b1-b4da0299397c","Type":"ContainerStarted","Data":"42bf28981a4df4f4244da5bb2542e4df20e2542cdcd3939a2113e9155d84fa2b"} Jun 09 11:45:59.535284 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.535245 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-sj7nx" podStartSLOduration=1.8843490219999999 podStartE2EDuration="3.535231723s" totalImagesPullingTime="1.650882701s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:59.534781996 +0000 UTC m=+38.615287962" watchObservedRunningTime="2026-06-09 11:45:59.535231723 +0000 UTC m=+38.615737660" Jun 09 11:45:59.559107 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.559014 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-dphf5" podStartSLOduration=8.620007013 podStartE2EDuration="38.558996319s" totalImagesPullingTime="29.938989306s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:45:59.558014498 +0000 UTC m=+38.638520426" watchObservedRunningTime="2026-06-09 11:45:59.558996319 +0000 UTC m=+38.639502251" Jun 09 11:45:59.684130 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.684098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:45:59.788596 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:45:59.788520 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:00.070059 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:00.069973 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:46:00.070184 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:00.070115 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:46:00.070222 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:00.070185 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:46:04.070170166 +0000 UTC m=+43.150676072 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:46:00.388627 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:00.388560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:00.488443 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:00.488411 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:01.407032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:01.407004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:01.467187 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:01.467162 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:04.098102 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:04.098074 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:46:04.098595 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:04.098254 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:46:04.098595 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:04.098330 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:46:12.098309769 +0000 UTC m=+51.178815675 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:46:04.910315 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:04.910278 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:04.961373 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:04.961339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:12.151875 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:12.151837 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:46:12.152443 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:12.151974 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:46:12.152443 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:12.152044 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:46:28.152028146 +0000 UTC m=+67.232534050 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:46:20.497369 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:20.497339 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-898tr" Jun 09 11:46:20.654218 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:20.654180 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:20.705246 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:20.705218 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:24.372589 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:24.372547 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:24.436791 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:24.436760 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:24.494021 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:24.493985 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:46:27.057323 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.057258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:46:27.057323 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.057325 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:46:27.060131 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.060114 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 09 11:46:27.060241 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.060226 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 09 11:46:27.068219 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:27.068203 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:46:27.068280 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:27.068269 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:47:31.068250247 +0000 UTC m=+130.148756166 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : secret "metrics-daemon-secret" not found Jun 09 11:46:27.071340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.071319 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0973fe4e-b071-4133-856b-f62e31484959-original-pull-secret\") pod \"global-pull-secret-syncer-8xxbv\" (UID: \"0973fe4e-b071-4133-856b-f62e31484959\") " pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:46:27.249869 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.249837 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8xxbv" Jun 09 11:46:27.258775 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.258747 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:46:27.261621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.261591 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 09 11:46:27.272187 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.272162 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 09 11:46:27.282502 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.282481 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dlggp\" (UniqueName: \"kubernetes.io/projected/c42b9278-8590-46b3-90bd-2bbe1304cd62-kube-api-access-dlggp\") pod \"network-check-target-p2bbl\" (UID: \"c42b9278-8590-46b3-90bd-2bbe1304cd62\") " pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:46:27.351191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.351166 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-h4spp\"" Jun 09 11:46:27.359319 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.359295 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:46:27.371257 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.371161 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8xxbv"] Jun 09 11:46:27.373562 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:46:27.373540 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0973fe4e_b071_4133_856b_f62e31484959.slice/crio-7ffa57d21a38ee93a333c46cde392dfcbb982c55b99aa4808c5b114ff6b07bdf WatchSource:0}: Error finding container 7ffa57d21a38ee93a333c46cde392dfcbb982c55b99aa4808c5b114ff6b07bdf: Status 404 returned error can't find the container with id 7ffa57d21a38ee93a333c46cde392dfcbb982c55b99aa4808c5b114ff6b07bdf Jun 09 11:46:27.475709 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.475682 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-p2bbl"] Jun 09 11:46:27.478755 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:46:27.478732 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc42b9278_8590_46b3_90bd_2bbe1304cd62.slice/crio-a8ed9b5b5c9d06f01a384ec81f4e08875b8d3f2ab6a05e44cce7a663e144ea26 WatchSource:0}: Error finding container a8ed9b5b5c9d06f01a384ec81f4e08875b8d3f2ab6a05e44cce7a663e144ea26: Status 404 returned error can't find the container with id a8ed9b5b5c9d06f01a384ec81f4e08875b8d3f2ab6a05e44cce7a663e144ea26 Jun 09 11:46:27.585417 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.585324 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2bbl" event={"ID":"c42b9278-8590-46b3-90bd-2bbe1304cd62","Type":"ContainerStarted","Data":"a8ed9b5b5c9d06f01a384ec81f4e08875b8d3f2ab6a05e44cce7a663e144ea26"} Jun 09 11:46:27.586394 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:27.586373 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8xxbv" event={"ID":"0973fe4e-b071-4133-856b-f62e31484959","Type":"ContainerStarted","Data":"7ffa57d21a38ee93a333c46cde392dfcbb982c55b99aa4808c5b114ff6b07bdf"} Jun 09 11:46:28.165470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:28.165360 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:46:28.165927 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:28.165548 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:46:28.165927 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:46:28.165623 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:47:00.165601839 +0000 UTC m=+99.246107763 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:46:32.601460 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:32.601416 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8xxbv" event={"ID":"0973fe4e-b071-4133-856b-f62e31484959","Type":"ContainerStarted","Data":"d158a6fcb4e2678867883e98ab19e21b00efc244b6e6b481211da69d5407043b"} Jun 09 11:46:32.602824 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:32.602798 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-p2bbl" event={"ID":"c42b9278-8590-46b3-90bd-2bbe1304cd62","Type":"ContainerStarted","Data":"b6123d515a4519bdecf10ba90afe15b743aa5830b2dae4e613a7c08dcf748104"} Jun 09 11:46:32.602949 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:32.602936 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:46:32.616478 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:32.616441 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8xxbv" podStartSLOduration=67.179466359 podStartE2EDuration="1m11.616428848s" totalImagesPullingTime="4.436962489s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:32.616093002 +0000 UTC m=+71.696598926" watchObservedRunningTime="2026-06-09 11:46:32.616428848 +0000 UTC m=+71.696934774" Jun 09 11:46:32.632806 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:46:32.632766 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-p2bbl" podStartSLOduration=67.304022498 podStartE2EDuration="1m11.632752895s" totalImagesPullingTime="4.328730397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:46:32.632264772 +0000 UTC m=+71.712770725" watchObservedRunningTime="2026-06-09 11:46:32.632752895 +0000 UTC m=+71.713258819" Jun 09 11:47:00.173242 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:47:00.173193 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:47:00.173763 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:47:00.173381 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:47:00.173763 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:47:00.173492 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:48:04.173469466 +0000 UTC m=+163.253975372 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:47:03.608248 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:47:03.608213 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-p2bbl" Jun 09 11:47:31.080319 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:47:31.080256 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:47:31.080766 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:47:31.080436 2578 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 09 11:47:31.080766 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:47:31.080518 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs podName:b4c17869-8277-4de5-bf8e-f7c78f6e548b nodeName:}" failed. No retries permitted until 2026-06-09 11:49:33.080502183 +0000 UTC m=+252.161008089 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs") pod "network-metrics-daemon-wq7cp" (UID: "b4c17869-8277-4de5-bf8e-f7c78f6e548b") : secret "metrics-daemon-secret" not found Jun 09 11:47:48.972808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:47:48.972738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:47:59.385920 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:47:59.385875 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5vf7n" podUID="5c52b33d-e979-4e97-90fd-197a7d8739ca" Jun 09 11:47:59.808803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:47:59.808769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:48:00.353071 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:00.353029 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wq7cp" podUID="b4c17869-8277-4de5-bf8e-f7c78f6e548b" Jun 09 11:48:04.205750 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:04.205713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:48:04.206174 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:04.205853 2578 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 09 11:48:04.206174 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:04.205906 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls podName:5c52b33d-e979-4e97-90fd-197a7d8739ca nodeName:}" failed. No retries permitted until 2026-06-09 11:50:06.205892725 +0000 UTC m=+285.286398630 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls") pod "dns-default-5vf7n" (UID: "5c52b33d-e979-4e97-90fd-197a7d8739ca") : secret "dns-default-metrics-tls" not found Jun 09 11:48:12.338368 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:12.338262 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:48:13.381075 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:13.381045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:41.820573 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.820542 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8"] Jun 09 11:48:41.822163 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.822147 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:41.830288 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.830260 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 09 11:48:41.830288 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.830281 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 09 11:48:41.831795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.831769 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-72sl7\"" Jun 09 11:48:41.831911 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.831829 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:48:41.831911 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.831892 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 09 11:48:41.832614 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.832594 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd"] Jun 09 11:48:41.834322 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.834305 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" Jun 09 11:48:41.845313 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.845295 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k5wrw\"" Jun 09 11:48:41.845496 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.845479 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jun 09 11:48:41.845932 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.845917 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:48:41.846475 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.846458 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8"] Jun 09 11:48:41.856032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.856012 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd"] Jun 09 11:48:41.935173 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.935146 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz"] Jun 09 11:48:41.940186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.940157 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-j5dlr"] Jun 09 11:48:41.940359 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.940293 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:41.941670 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.941651 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:48:41.941798 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.941747 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:41.943101 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.943082 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:41.945276 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.945255 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn"] Jun 09 11:48:41.946730 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.946715 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:41.951508 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.951490 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 09 11:48:41.951621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.951559 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 09 11:48:41.951621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.951569 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-pcmrj\"" Jun 09 11:48:41.951621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.951543 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 09 11:48:41.952305 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952283 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jun 09 11:48:41.952422 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952337 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jun 09 11:48:41.952422 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952354 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-66tvw\"" Jun 09 11:48:41.952422 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952358 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-pbp7v\"" Jun 09 11:48:41.952610 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952436 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 09 11:48:41.952610 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952518 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jun 09 11:48:41.952724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952711 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:48:41.953015 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.952998 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jun 09 11:48:41.953083 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.953067 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 09 11:48:41.953154 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.953096 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:48:41.953224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.953203 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-vmdcc\"" Jun 09 11:48:41.953554 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.953538 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 09 11:48:41.955072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.955049 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hzx6c\" (UniqueName: \"kubernetes.io/projected/e2b5f7ea-f254-4776-a3f3-75b48f49beb5-kube-api-access-hzx6c\") pod \"volume-data-source-validator-78dd696465-jxqqd\" (UID: \"e2b5f7ea-f254-4776-a3f3-75b48f49beb5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" Jun 09 11:48:41.955157 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.955108 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b91d017f-f098-47a4-94a1-5215375159f7-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:41.955199 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.955181 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5khzr\" (UniqueName: \"kubernetes.io/projected/b91d017f-f098-47a4-94a1-5215375159f7-kube-api-access-5khzr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:41.955252 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.955212 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b91d017f-f098-47a4-94a1-5215375159f7-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:41.959887 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.959865 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jun 09 11:48:41.961076 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.961056 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 09 11:48:41.961178 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.961062 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz"] Jun 09 11:48:41.968317 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.968294 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jun 09 11:48:41.977824 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.977796 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn"] Jun 09 11:48:41.978609 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.978590 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:48:41.988551 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:41.988526 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-j5dlr"] Jun 09 11:48:42.056525 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056460 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b91d017f-f098-47a4-94a1-5215375159f7-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.056525 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056523 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-trusted-ca\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.056776 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056548 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hzx6c\" (UniqueName: \"kubernetes.io/projected/e2b5f7ea-f254-4776-a3f3-75b48f49beb5-kube-api-access-hzx6c\") pod \"volume-data-source-validator-78dd696465-jxqqd\" (UID: \"e2b5f7ea-f254-4776-a3f3-75b48f49beb5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" Jun 09 11:48:42.056776 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056737 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-config\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.056885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056780 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cwnr9\" (UniqueName: \"kubernetes.io/projected/61657ac6-eb2a-46f5-b10d-139d6a2abf92-kube-api-access-cwnr9\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.056885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056842 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.056885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057019 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056907 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057019 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056941 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057019 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056972 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057019 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.056994 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.057206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057045 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5khzr\" (UniqueName: \"kubernetes.io/projected/b91d017f-f098-47a4-94a1-5215375159f7-kube-api-access-5khzr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.057206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057068 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c810dd6-518d-42ea-bcd1-f1195a3e8162-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.057206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.057206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057149 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057189 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c810dd6-518d-42ea-bcd1-f1195a3e8162-config\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.057461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61657ac6-eb2a-46f5-b10d-139d6a2abf92-serving-cert\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.057461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057246 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b91d017f-f098-47a4-94a1-5215375159f7-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.057461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057276 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4dnb\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.057461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057324 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4grm\" (UniqueName: \"kubernetes.io/projected/9c810dd6-518d-42ea-bcd1-f1195a3e8162-kube-api-access-l4grm\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.057461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.057372 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.058051 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.058024 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b91d017f-f098-47a4-94a1-5215375159f7-config\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.059138 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.059117 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b91d017f-f098-47a4-94a1-5215375159f7-serving-cert\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.077142 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.077077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5khzr\" (UniqueName: \"kubernetes.io/projected/b91d017f-f098-47a4-94a1-5215375159f7-kube-api-access-5khzr\") pod \"kube-storage-version-migrator-operator-55bb7c4d49-pdrz8\" (UID: \"b91d017f-f098-47a4-94a1-5215375159f7\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.077626 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.077608 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hzx6c\" (UniqueName: \"kubernetes.io/projected/e2b5f7ea-f254-4776-a3f3-75b48f49beb5-kube-api-access-hzx6c\") pod \"volume-data-source-validator-78dd696465-jxqqd\" (UID: \"e2b5f7ea-f254-4776-a3f3-75b48f49beb5\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" Jun 09 11:48:42.130997 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.130967 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" Jun 09 11:48:42.142571 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.142550 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" Jun 09 11:48:42.158501 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158473 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4grm\" (UniqueName: \"kubernetes.io/projected/9c810dd6-518d-42ea-bcd1-f1195a3e8162-kube-api-access-l4grm\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.158637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158507 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158553 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-trusted-ca\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.158637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158585 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-config\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.158637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158610 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cwnr9\" (UniqueName: \"kubernetes.io/projected/61657ac6-eb2a-46f5-b10d-139d6a2abf92-kube-api-access-cwnr9\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.158637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158632 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158652 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158713 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158760 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158792 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c810dd6-518d-42ea-bcd1-f1195a3e8162-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158816 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158855 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.158883 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.158872 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:48:42.159347 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158885 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c810dd6-518d-42ea-bcd1-f1195a3e8162-config\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.159347 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158921 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61657ac6-eb2a-46f5-b10d-139d6a2abf92-serving-cert\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.159347 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.158979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4dnb\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.159529 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.159452 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-config\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.159625 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.159603 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.159692 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.158898 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b569b74f-bmnsv: secret "image-registry-tls" not found Jun 09 11:48:42.159692 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.159682 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-nginx-conf\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.159800 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.159749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.160237 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.160210 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/9c810dd6-518d-42ea-bcd1-f1195a3e8162-config\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.160383 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.160367 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls podName:403367f1-a6ac-4db7-a9c6-d2abce134d25 nodeName:}" failed. No retries permitted until 2026-06-09 11:48:42.660335003 +0000 UTC m=+201.740840923 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls") pod "image-registry-68b569b74f-bmnsv" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25") : secret "image-registry-tls" not found Jun 09 11:48:42.160383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.160369 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.160545 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.159348 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:42.160739 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.160702 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:48:42.660469545 +0000 UTC m=+201.740975449 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:42.161840 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.161810 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/61657ac6-eb2a-46f5-b10d-139d6a2abf92-trusted-ca\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.162239 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.162158 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.162239 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.162203 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.162239 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.162222 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/9c810dd6-518d-42ea-bcd1-f1195a3e8162-serving-cert\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.162690 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.162672 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/61657ac6-eb2a-46f5-b10d-139d6a2abf92-serving-cert\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.195909 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.195881 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4dnb\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.196799 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.196769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.198546 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.198493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4grm\" (UniqueName: \"kubernetes.io/projected/9c810dd6-518d-42ea-bcd1-f1195a3e8162-kube-api-access-l4grm\") pod \"service-ca-operator-6bc5ff68f5-6d4rz\" (UID: \"9c810dd6-518d-42ea-bcd1-f1195a3e8162\") " pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.210828 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.210775 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cwnr9\" (UniqueName: \"kubernetes.io/projected/61657ac6-eb2a-46f5-b10d-139d6a2abf92-kube-api-access-cwnr9\") pod \"console-operator-668fdbf85c-j5dlr\" (UID: \"61657ac6-eb2a-46f5-b10d-139d6a2abf92\") " pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.249864 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.249834 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" Jun 09 11:48:42.257918 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.257887 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:42.287783 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.287743 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd"] Jun 09 11:48:42.291112 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:42.291084 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2b5f7ea_f254_4776_a3f3_75b48f49beb5.slice/crio-90885340477cf74f93f75759198027832e22e7c73d28d2718c6c6dc57a95fae8 WatchSource:0}: Error finding container 90885340477cf74f93f75759198027832e22e7c73d28d2718c6c6dc57a95fae8: Status 404 returned error can't find the container with id 90885340477cf74f93f75759198027832e22e7c73d28d2718c6c6dc57a95fae8 Jun 09 11:48:42.323678 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.323644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8"] Jun 09 11:48:42.326877 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:42.326834 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb91d017f_f098_47a4_94a1_5215375159f7.slice/crio-e7a1e9e031b89c3d1145f7ecdbfb5945af030cbeef4b4250674ee3c46e1f1cfb WatchSource:0}: Error finding container e7a1e9e031b89c3d1145f7ecdbfb5945af030cbeef4b4250674ee3c46e1f1cfb: Status 404 returned error can't find the container with id e7a1e9e031b89c3d1145f7ecdbfb5945af030cbeef4b4250674ee3c46e1f1cfb Jun 09 11:48:42.419819 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.419781 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz"] Jun 09 11:48:42.422606 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:42.422582 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c810dd6_518d_42ea_bcd1_f1195a3e8162.slice/crio-ceac22600e0578f64aec5fec92f909a601d4a3b20d5b24c550c79579797ae449 WatchSource:0}: Error finding container ceac22600e0578f64aec5fec92f909a601d4a3b20d5b24c550c79579797ae449: Status 404 returned error can't find the container with id ceac22600e0578f64aec5fec92f909a601d4a3b20d5b24c550c79579797ae449 Jun 09 11:48:42.427341 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.427320 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-668fdbf85c-j5dlr"] Jun 09 11:48:42.430982 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:42.430954 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61657ac6_eb2a_46f5_b10d_139d6a2abf92.slice/crio-7f5a62647d1ba3aed6703a39903f37e2cf96ee3d72a561363beeeec94f5cb327 WatchSource:0}: Error finding container 7f5a62647d1ba3aed6703a39903f37e2cf96ee3d72a561363beeeec94f5cb327: Status 404 returned error can't find the container with id 7f5a62647d1ba3aed6703a39903f37e2cf96ee3d72a561363beeeec94f5cb327 Jun 09 11:48:42.485829 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.485787 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:42.625102 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.625012 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:42.664208 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.664174 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:42.664208 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.664209 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:42.664433 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.664319 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:42.664433 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.664372 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:48:43.664359064 +0000 UTC m=+202.744864969 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:42.664433 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.664323 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:48:42.664433 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.664434 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b569b74f-bmnsv: secret "image-registry-tls" not found Jun 09 11:48:42.664562 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:42.664479 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls podName:403367f1-a6ac-4db7-a9c6-d2abce134d25 nodeName:}" failed. No retries permitted until 2026-06-09 11:48:43.664464786 +0000 UTC m=+202.744970701 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls") pod "image-registry-68b569b74f-bmnsv" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25") : secret "image-registry-tls" not found Jun 09 11:48:42.916895 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.916729 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" event={"ID":"b91d017f-f098-47a4-94a1-5215375159f7","Type":"ContainerStarted","Data":"e7a1e9e031b89c3d1145f7ecdbfb5945af030cbeef4b4250674ee3c46e1f1cfb"} Jun 09 11:48:42.920377 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.920346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" event={"ID":"61657ac6-eb2a-46f5-b10d-139d6a2abf92","Type":"ContainerStarted","Data":"7f5a62647d1ba3aed6703a39903f37e2cf96ee3d72a561363beeeec94f5cb327"} Jun 09 11:48:42.922968 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.922939 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" event={"ID":"9c810dd6-518d-42ea-bcd1-f1195a3e8162","Type":"ContainerStarted","Data":"ceac22600e0578f64aec5fec92f909a601d4a3b20d5b24c550c79579797ae449"} Jun 09 11:48:42.925612 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:42.925585 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" event={"ID":"e2b5f7ea-f254-4776-a3f3-75b48f49beb5","Type":"ContainerStarted","Data":"90885340477cf74f93f75759198027832e22e7c73d28d2718c6c6dc57a95fae8"} Jun 09 11:48:43.676997 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:43.676951 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:43.677188 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:43.677006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:43.677188 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:43.677106 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:48:43.677188 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:43.677125 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:43.677188 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:43.677130 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b569b74f-bmnsv: secret "image-registry-tls" not found Jun 09 11:48:43.677188 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:43.677184 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:48:45.677167026 +0000 UTC m=+204.757672937 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:43.677506 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:43.677203 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls podName:403367f1-a6ac-4db7-a9c6-d2abce134d25 nodeName:}" failed. No retries permitted until 2026-06-09 11:48:45.677193757 +0000 UTC m=+204.757699665 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls") pod "image-registry-68b569b74f-bmnsv" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25") : secret "image-registry-tls" not found Jun 09 11:48:43.930755 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:43.930717 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" event={"ID":"e2b5f7ea-f254-4776-a3f3-75b48f49beb5","Type":"ContainerStarted","Data":"c449cfa287b5e3ba32012236453fd647ac76f13b60813a9d53b2598e3f170547"} Jun 09 11:48:43.950303 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:43.950246 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78dd696465-jxqqd" podStartSLOduration=1.756970204 podStartE2EDuration="2.950226046s" totalImagesPullingTime="1.193255842s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:43.949922031 +0000 UTC m=+203.030427984" watchObservedRunningTime="2026-06-09 11:48:43.950226046 +0000 UTC m=+203.030731973" Jun 09 11:48:44.056592 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:44.056551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:44.158758 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:44.158720 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:45.694488 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.694451 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.694497 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:45.694623 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:45.694648 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b569b74f-bmnsv: secret "image-registry-tls" not found Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:45.694658 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:45.694712 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:48:49.694695484 +0000 UTC m=+208.775201389 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:45.694890 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:45.694731 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls podName:403367f1-a6ac-4db7-a9c6-d2abce134d25 nodeName:}" failed. No retries permitted until 2026-06-09 11:48:49.694725111 +0000 UTC m=+208.775231015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls") pod "image-registry-68b569b74f-bmnsv" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25") : secret "image-registry-tls" not found Jun 09 11:48:45.938685 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.938648 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" event={"ID":"b91d017f-f098-47a4-94a1-5215375159f7","Type":"ContainerStarted","Data":"cefa9674eed6d16c77a3f00cafb5da23ec15e99515b7ce523fbcdc7362c9203b"} Jun 09 11:48:45.940344 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.940324 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/0.log" Jun 09 11:48:45.940510 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.940361 2578 generic.go:356] "Generic (PLEG): container finished" podID="61657ac6-eb2a-46f5-b10d-139d6a2abf92" containerID="7ffbdd311f3b56fff1d5f1460f0c18b10118f77d2eb5a57ff4e901a640f823a5" exitCode=255 Jun 09 11:48:45.940510 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.940452 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" event={"ID":"61657ac6-eb2a-46f5-b10d-139d6a2abf92","Type":"ContainerDied","Data":"7ffbdd311f3b56fff1d5f1460f0c18b10118f77d2eb5a57ff4e901a640f823a5"} Jun 09 11:48:45.940668 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.940651 2578 scope.go:117] "RemoveContainer" containerID="7ffbdd311f3b56fff1d5f1460f0c18b10118f77d2eb5a57ff4e901a640f823a5" Jun 09 11:48:45.942131 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.942080 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" event={"ID":"9c810dd6-518d-42ea-bcd1-f1195a3e8162","Type":"ContainerStarted","Data":"30f4002492590374f67ac7aec609fc9ded3e5c6a5bc14a11e4a72c2043e8923d"} Jun 09 11:48:45.948779 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:45.948689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:46.004639 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.004574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" podStartSLOduration=2.183835992 podStartE2EDuration="5.004552826s" totalImagesPullingTime="2.820716834s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:46.004135206 +0000 UTC m=+205.084641154" watchObservedRunningTime="2026-06-09 11:48:46.004552826 +0000 UTC m=+205.085058754" Jun 09 11:48:46.005231 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.005190 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" podStartSLOduration=2.094460142 podStartE2EDuration="5.005174715s" totalImagesPullingTime="2.910714573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:45.973001416 +0000 UTC m=+205.053507355" watchObservedRunningTime="2026-06-09 11:48:46.005174715 +0000 UTC m=+205.085680643" Jun 09 11:48:46.149737 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.149692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:46.477039 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.477009 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:46.605599 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.605568 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:46.906647 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.906556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:46.951697 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.951670 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:48:46.952131 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.952115 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/0.log" Jun 09 11:48:46.952197 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.952148 2578 generic.go:356] "Generic (PLEG): container finished" podID="61657ac6-eb2a-46f5-b10d-139d6a2abf92" containerID="be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2" exitCode=255 Jun 09 11:48:46.952252 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.952214 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" event={"ID":"61657ac6-eb2a-46f5-b10d-139d6a2abf92","Type":"ContainerDied","Data":"be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2"} Jun 09 11:48:46.952322 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.952294 2578 scope.go:117] "RemoveContainer" containerID="7ffbdd311f3b56fff1d5f1460f0c18b10118f77d2eb5a57ff4e901a640f823a5" Jun 09 11:48:46.952526 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:46.952507 2578 scope.go:117] "RemoveContainer" containerID="be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2" Jun 09 11:48:46.952719 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:46.952692 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-j5dlr_openshift-console-operator(61657ac6-eb2a-46f5-b10d-139d6a2abf92)\"" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" podUID="61657ac6-eb2a-46f5-b10d-139d6a2abf92" Jun 09 11:48:47.013725 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.013690 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:47.165644 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.165546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:47.269910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.269867 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:47.665810 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.665782 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fv2r_72875ed7-85a7-46a1-989a-ad83cc45942e/dns-node-resolver/0.log" Jun 09 11:48:47.957343 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.957265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:48:47.957696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:47.957683 2578 scope.go:117] "RemoveContainer" containerID="be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2" Jun 09 11:48:47.957858 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:47.957839 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-j5dlr_openshift-console-operator(61657ac6-eb2a-46f5-b10d-139d6a2abf92)\"" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" podUID="61657ac6-eb2a-46f5-b10d-139d6a2abf92" Jun 09 11:48:48.792952 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.792912 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k5z6d"] Jun 09 11:48:48.797042 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.797020 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.800576 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.800558 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jun 09 11:48:48.804277 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.804252 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jun 09 11:48:48.804758 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.804745 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jun 09 11:48:48.805191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.805174 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jun 09 11:48:48.806036 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.806022 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-xjwv5\"" Jun 09 11:48:48.817351 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.817329 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-key\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.817470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.817364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bj77w\" (UniqueName: \"kubernetes.io/projected/833a74c4-581e-4b4e-a24e-507629fc6adb-kube-api-access-bj77w\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.817470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.817390 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-cabundle\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.821737 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.821714 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k5z6d"] Jun 09 11:48:48.880987 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.880957 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x2ml5_396faeea-35a2-4a9e-9df4-fadf363a70f3/node-ca/0.log" Jun 09 11:48:48.918328 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.918298 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-key\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.918503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.918352 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bj77w\" (UniqueName: \"kubernetes.io/projected/833a74c4-581e-4b4e-a24e-507629fc6adb-kube-api-access-bj77w\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.918503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.918391 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-cabundle\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.919166 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.919136 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-cabundle\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.919500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.919473 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:48.921167 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.921143 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/833a74c4-581e-4b4e-a24e-507629fc6adb-signing-key\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:48.933835 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:48.933808 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bj77w\" (UniqueName: \"kubernetes.io/projected/833a74c4-581e-4b4e-a24e-507629fc6adb-kube-api-access-bj77w\") pod \"service-ca-7d74d578b8-k5z6d\" (UID: \"833a74c4-581e-4b4e-a24e-507629fc6adb\") " pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:49.091895 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.091854 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:49.105750 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.105728 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" Jun 09 11:48:49.260243 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.260209 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-7d74d578b8-k5z6d"] Jun 09 11:48:49.263284 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:49.263257 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod833a74c4_581e_4b4e_a24e_507629fc6adb.slice/crio-77bdd78631a242b6c701810232864b76143416e68732a8767f9bca6dc18db714 WatchSource:0}: Error finding container 77bdd78631a242b6c701810232864b76143416e68732a8767f9bca6dc18db714: Status 404 returned error can't find the container with id 77bdd78631a242b6c701810232864b76143416e68732a8767f9bca6dc18db714 Jun 09 11:48:49.724603 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.724560 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:49.724603 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.724600 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:49.724811 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:49.724709 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:49.724811 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:49.724768 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:48:57.724753612 +0000 UTC m=+216.805259517 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:49.724811 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:49.724713 2578 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 09 11:48:49.724811 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:49.724793 2578 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-68b569b74f-bmnsv: secret "image-registry-tls" not found Jun 09 11:48:49.724936 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:49.724827 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls podName:403367f1-a6ac-4db7-a9c6-d2abce134d25 nodeName:}" failed. No retries permitted until 2026-06-09 11:48:57.72481675 +0000 UTC m=+216.805322655 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls") pod "image-registry-68b569b74f-bmnsv" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25") : secret "image-registry-tls" not found Jun 09 11:48:49.866529 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.866506 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sj7nx_e996d8a9-62a8-46c4-a678-2f471fd81ca6/serve-healthcheck-canary/0.log" Jun 09 11:48:49.964855 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.964822 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" event={"ID":"833a74c4-581e-4b4e-a24e-507629fc6adb","Type":"ContainerStarted","Data":"a3b2cd9111d28ed2e4613420afdd46d91bd1ab8463f6dd9b8b3b405b5d0ba3c3"} Jun 09 11:48:49.965004 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:49.964869 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" event={"ID":"833a74c4-581e-4b4e-a24e-507629fc6adb","Type":"ContainerStarted","Data":"77bdd78631a242b6c701810232864b76143416e68732a8767f9bca6dc18db714"} Jun 09 11:48:50.001698 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:50.001597 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-7d74d578b8-k5z6d" podStartSLOduration=2.001580523 podStartE2EDuration="2.001580523s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:50.000076901 +0000 UTC m=+209.080582856" watchObservedRunningTime="2026-06-09 11:48:50.001580523 +0000 UTC m=+209.082086467" Jun 09 11:48:50.487586 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:50.487553 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:50.604968 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:50.604931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:50.804835 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:50.804789 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:50.935185 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:50.935152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:51.407877 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:51.407838 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:52.131945 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.131896 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:52.258702 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.258659 2578 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:52.258885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.258736 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:48:52.259182 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.259168 2578 scope.go:117] "RemoveContainer" containerID="be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2" Jun 09 11:48:52.259378 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:52.259355 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-668fdbf85c-j5dlr_openshift-console-operator(61657ac6-eb2a-46f5-b10d-139d6a2abf92)\"" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" podUID="61657ac6-eb2a-46f5-b10d-139d6a2abf92" Jun 09 11:48:52.299392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.299362 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:52.506679 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.506583 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:52.896448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:52.896388 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:53.709502 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:53.709466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:53.905539 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:53.905505 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:54.344531 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:54.344484 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:54.548684 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:54.548645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:54.688893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:54.688807 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:55.165037 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:55.165001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:55.777244 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:55.777209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:55.961602 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:55.961560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:56.121246 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:56.121214 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:56.297498 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:56.297452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:56.842179 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:56.842138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:57.324573 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.324536 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:57.732900 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.732810 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:57.785608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.785572 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:57.785793 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.785616 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:48:57.785793 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:57.785735 2578 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jun 09 11:48:57.785909 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:48:57.785804 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert podName:4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e nodeName:}" failed. No retries permitted until 2026-06-09 11:49:13.785786328 +0000 UTC m=+232.866292238 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert") pod "networking-console-plugin-d5d5bb78b-5cxzn" (UID: "4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e") : secret "networking-console-plugin-cert" not found Jun 09 11:48:57.788120 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.788096 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"image-registry-68b569b74f-bmnsv\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:57.865062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.865021 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:57.913344 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:57.913310 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.014374 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.014348 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:48:58.015902 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:48:58.015875 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod403367f1_a6ac_4db7_a9c6_d2abce134d25.slice/crio-729fb35d9a59b6c5d304ea0f62ed68118a57371f4fa80de9af4ce7bdba9fa89d WatchSource:0}: Error finding container 729fb35d9a59b6c5d304ea0f62ed68118a57371f4fa80de9af4ce7bdba9fa89d: Status 404 returned error can't find the container with id 729fb35d9a59b6c5d304ea0f62ed68118a57371f4fa80de9af4ce7bdba9fa89d Jun 09 11:48:58.116247 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.116208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.287369 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.287281 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.393180 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.393140 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:58.993997 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.993963 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" event={"ID":"403367f1-a6ac-4db7-a9c6-d2abce134d25","Type":"ContainerStarted","Data":"d5fdbab76bea4ee209e1d93c6a15885b71ff81bb2ecbad9893de53e8eb8d340f"} Jun 09 11:48:58.993997 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.994009 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" event={"ID":"403367f1-a6ac-4db7-a9c6-d2abce134d25","Type":"ContainerStarted","Data":"729fb35d9a59b6c5d304ea0f62ed68118a57371f4fa80de9af4ce7bdba9fa89d"} Jun 09 11:48:58.994220 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:58.994076 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:48:59.050767 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:59.050712 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podStartSLOduration=18.050693924 podStartE2EDuration="18.050693924s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:48:59.050332768 +0000 UTC m=+218.130838695" watchObservedRunningTime="2026-06-09 11:48:59.050693924 +0000 UTC m=+218.131199850" Jun 09 11:48:59.563290 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:59.563252 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:59.792207 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:59.792122 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:48:59.912021 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:48:59.911992 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:00.186500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:00.186466 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:00.335195 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:00.335154 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:00.713288 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:00.713248 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:00.853130 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:00.853094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:00.956994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:00.956942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.082230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:01.082194 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.193162 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:01.193130 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.568222 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:01.568192 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:01.895864 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:01.895740 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:03.338588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:03.338561 2578 scope.go:117] "RemoveContainer" containerID="be2f0b0e7c4f3ee1eba4e23e6c0258a04e96e253beb1791277ddfbe9f46c1fe2" Jun 09 11:49:03.873804 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:03.873763 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:03.978947 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:03.978899 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.010867 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.010844 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:49:04.011027 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.010927 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" event={"ID":"61657ac6-eb2a-46f5-b10d-139d6a2abf92","Type":"ContainerStarted","Data":"f3bc1dc524467ce20117978dacae54c6ad4431bd52568dcedb7443589b28dac2"} Jun 09 11:49:04.011212 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.011183 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:49:04.015853 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.015819 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" Jun 09 11:49:04.033837 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.033790 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-668fdbf85c-j5dlr" podStartSLOduration=20.225405819 podStartE2EDuration="23.033774838s" totalImagesPullingTime="2.808369019s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:04.033011073 +0000 UTC m=+223.113516999" watchObservedRunningTime="2026-06-09 11:49:04.033774838 +0000 UTC m=+223.114280779" Jun 09 11:49:04.151695 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.151599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.330448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.330394 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.420111 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.420032 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.749613 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.749522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.839191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.839123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:04.945443 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:04.945395 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:05.051124 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:05.051092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:05.586508 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:05.586472 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:05.700833 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:05.700795 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:05.810780 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:05.810743 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:05.981531 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:05.981445 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:06.143224 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:06.143183 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:06.793241 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:06.793209 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:06.888053 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:06.888021 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:09.474886 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:09.474857 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:12.803162 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:12.803125 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:12.885560 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:12.885530 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:13.819727 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:13.819693 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:49:13.822145 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:13.822120 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e-networking-console-plugin-cert\") pod \"networking-console-plugin-d5d5bb78b-5cxzn\" (UID: \"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e\") " pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:49:14.069148 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:14.069114 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" Jun 09 11:49:14.199186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:14.199149 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn"] Jun 09 11:49:14.202364 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:14.202336 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bef8fe7_f4ec_41cb_a5cf_098d1588fd4e.slice/crio-d6f498dc41710b116694cb716b94346c296f76924ba02a4d039c8db64f00f8dd WatchSource:0}: Error finding container d6f498dc41710b116694cb716b94346c296f76924ba02a4d039c8db64f00f8dd: Status 404 returned error can't find the container with id d6f498dc41710b116694cb716b94346c296f76924ba02a4d039c8db64f00f8dd Jun 09 11:49:15.044783 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:15.044751 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" event={"ID":"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e","Type":"ContainerStarted","Data":"d6f498dc41710b116694cb716b94346c296f76924ba02a4d039c8db64f00f8dd"} Jun 09 11:49:16.052457 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:16.052423 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" event={"ID":"4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e","Type":"ContainerStarted","Data":"0872c291049c9d46e9ebafc158832960fcd867a1286a0cf38c83e49a0dd92abe"} Jun 09 11:49:16.070689 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:16.070622 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-d5d5bb78b-5cxzn" podStartSLOduration=33.920428291 podStartE2EDuration="35.070607741s" totalImagesPullingTime="1.15017945s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:48:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:16.06932709 +0000 UTC m=+235.149833016" watchObservedRunningTime="2026-06-09 11:49:16.070607741 +0000 UTC m=+235.151113668" Jun 09 11:49:17.772118 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:17.772087 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:17.869810 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:17.869778 2578 patch_prober.go:28] interesting pod/image-registry-68b569b74f-bmnsv container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:49:17.869994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:17.869832 2578 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:49:17.881955 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:17.881921 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:18.346787 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.346754 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zvmx2"] Jun 09 11:49:18.349827 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.349803 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.352561 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.352535 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 09 11:49:18.353602 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.353580 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 09 11:49:18.354450 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.354433 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 09 11:49:18.354450 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.354439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 09 11:49:18.354675 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.354439 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-n5cf6\"" Jun 09 11:49:18.372642 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.372613 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvmx2"] Jun 09 11:49:18.436249 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.436219 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:49:18.440354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.440325 2578 patch_prober.go:28] interesting pod/image-registry-68b569b74f-bmnsv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:49:18.440521 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.440393 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:49:18.457902 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.457874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9f5m\" (UniqueName: \"kubernetes.io/projected/02602828-ed14-48f4-9704-636c406b5cf1-kube-api-access-f9f5m\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.458053 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.457908 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02602828-ed14-48f4-9704-636c406b5cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.458053 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.457973 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02602828-ed14-48f4-9704-636c406b5cf1-crio-socket\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.458137 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.458053 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02602828-ed14-48f4-9704-636c406b5cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.458137 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.458072 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02602828-ed14-48f4-9704-636c406b5cf1-data-volume\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.489793 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.489759 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-6657875f97-mmjm5"] Jun 09 11:49:18.493686 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.493660 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:18.493843 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.493769 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:18.496633 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.496612 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.497686 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.497664 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 09 11:49:18.497803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.497664 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sqlr7\"" Jun 09 11:49:18.497803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.497748 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 09 11:49:18.499633 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.499616 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-6t2xk\"" Jun 09 11:49:18.500698 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.500676 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 09 11:49:18.504209 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.504189 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 09 11:49:18.504307 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.504193 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 09 11:49:18.504527 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.504514 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 09 11:49:18.510949 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.510927 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 09 11:49:18.514670 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.514639 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mmjm5"] Jun 09 11:49:18.547640 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.547604 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:18.558702 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558675 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02602828-ed14-48f4-9704-636c406b5cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.558844 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558713 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p798d\" (UniqueName: \"kubernetes.io/projected/c2ee02bb-dab2-4454-91f3-b4095af7a261-kube-api-access-p798d\") pod \"downloads-6657875f97-mmjm5\" (UID: \"c2ee02bb-dab2-4454-91f3-b4095af7a261\") " pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:18.558844 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.558844 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558774 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02602828-ed14-48f4-9704-636c406b5cf1-crio-socket\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.558844 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558826 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92lv5\" (UniqueName: \"kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.558844 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558833 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/02602828-ed14-48f4-9704-636c406b5cf1-crio-socket\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.559010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558875 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.559010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.559010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.559010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.558982 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02602828-ed14-48f4-9704-636c406b5cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.559010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.559008 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02602828-ed14-48f4-9704-636c406b5cf1-data-volume\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.559205 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.559035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.559205 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.559182 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9f5m\" (UniqueName: \"kubernetes.io/projected/02602828-ed14-48f4-9704-636c406b5cf1-kube-api-access-f9f5m\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.559290 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.559187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/02602828-ed14-48f4-9704-636c406b5cf1-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.559290 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.559275 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/02602828-ed14-48f4-9704-636c406b5cf1-data-volume\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.561362 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.561338 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/02602828-ed14-48f4-9704-636c406b5cf1-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.591554 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.591522 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9f5m\" (UniqueName: \"kubernetes.io/projected/02602828-ed14-48f4-9704-636c406b5cf1-kube-api-access-f9f5m\") pod \"insights-runtime-extractor-zvmx2\" (UID: \"02602828-ed14-48f4-9704-636c406b5cf1\") " pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.608278 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.608204 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:18.659790 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.659753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zvmx2" Jun 09 11:49:18.659987 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.659900 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p798d\" (UniqueName: \"kubernetes.io/projected/c2ee02bb-dab2-4454-91f3-b4095af7a261-kube-api-access-p798d\") pod \"downloads-6657875f97-mmjm5\" (UID: \"c2ee02bb-dab2-4454-91f3-b4095af7a261\") " pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:18.659987 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.659935 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.659994 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92lv5\" (UniqueName: \"kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660027 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660085 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660333 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660134 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660846 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660817 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660970 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660853 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.660970 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.660906 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.662716 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.662688 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.662809 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.662726 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.671150 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.671122 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-92lv5\" (UniqueName: \"kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5\") pod \"console-f4cd8cc9b-j5hvf\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.674361 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.674345 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p798d\" (UniqueName: \"kubernetes.io/projected/c2ee02bb-dab2-4454-91f3-b4095af7a261-kube-api-access-p798d\") pod \"downloads-6657875f97-mmjm5\" (UID: \"c2ee02bb-dab2-4454-91f3-b4095af7a261\") " pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:18.735165 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.735137 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:18.804355 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.804323 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:18.810217 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.810200 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:18.838233 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.838202 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zvmx2"] Jun 09 11:49:18.838233 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:18.838226 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02602828_ed14_48f4_9704_636c406b5cf1.slice/crio-8c004fd297ebdf603660f967fc8a35a13fb2e950e8de7ae66e802eba22f746a7 WatchSource:0}: Error finding container 8c004fd297ebdf603660f967fc8a35a13fb2e950e8de7ae66e802eba22f746a7: Status 404 returned error can't find the container with id 8c004fd297ebdf603660f967fc8a35a13fb2e950e8de7ae66e802eba22f746a7 Jun 09 11:49:18.896570 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.896476 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:18.996207 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:18.996173 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-6657875f97-mmjm5"] Jun 09 11:49:18.999023 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:18.998978 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2ee02bb_dab2_4454_91f3_b4095af7a261.slice/crio-4fe4c44842eb60f65cca69eab898aa530219621a1b33c085e0420cb122a53dbe WatchSource:0}: Error finding container 4fe4c44842eb60f65cca69eab898aa530219621a1b33c085e0420cb122a53dbe: Status 404 returned error can't find the container with id 4fe4c44842eb60f65cca69eab898aa530219621a1b33c085e0420cb122a53dbe Jun 09 11:49:19.015763 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:19.015738 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod071999ae_72bb_43de_881e_c1f5a8a07f2b.slice/crio-146a9d6cc7805dc67a698b973d565b629af163ee6209cda1bee456ac77e631ed WatchSource:0}: Error finding container 146a9d6cc7805dc67a698b973d565b629af163ee6209cda1bee456ac77e631ed: Status 404 returned error can't find the container with id 146a9d6cc7805dc67a698b973d565b629af163ee6209cda1bee456ac77e631ed Jun 09 11:49:19.016415 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.016384 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:19.027421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.027354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:19.063039 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.063006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mmjm5" event={"ID":"c2ee02bb-dab2-4454-91f3-b4095af7a261","Type":"ContainerStarted","Data":"4fe4c44842eb60f65cca69eab898aa530219621a1b33c085e0420cb122a53dbe"} Jun 09 11:49:19.064177 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.064152 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cd8cc9b-j5hvf" event={"ID":"071999ae-72bb-43de-881e-c1f5a8a07f2b","Type":"ContainerStarted","Data":"146a9d6cc7805dc67a698b973d565b629af163ee6209cda1bee456ac77e631ed"} Jun 09 11:49:19.065517 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.065494 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvmx2" event={"ID":"02602828-ed14-48f4-9704-636c406b5cf1","Type":"ContainerStarted","Data":"3aba37bb25c7e55ee523a37c3a8032bbd32edac6be995bf6593de063cae37e0b"} Jun 09 11:49:19.065599 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.065543 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvmx2" event={"ID":"02602828-ed14-48f4-9704-636c406b5cf1","Type":"ContainerStarted","Data":"8c004fd297ebdf603660f967fc8a35a13fb2e950e8de7ae66e802eba22f746a7"} Jun 09 11:49:19.770912 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.770827 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:49:19.787299 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.787265 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.790047 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.789987 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:49:19.796225 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.796198 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 09 11:49:19.869340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869292 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869341 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8lssp\" (UniqueName: \"kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869419 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869483 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869543 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869569 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.869891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.869685 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970783 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970728 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970803 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970826 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970873 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970930 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.970973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970953 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8lssp\" (UniqueName: \"kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.971229 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.970984 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.971828 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.971794 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.972009 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.971985 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.972421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.972362 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.972913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.972887 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.974535 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.974418 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.975292 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.975248 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:19.981781 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:19.981733 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8lssp\" (UniqueName: \"kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp\") pod \"console-7d74b9cd9f-djmc4\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:20.102230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:20.102060 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:20.357594 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:20.357494 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:49:20.363033 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:20.362993 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc33757d_aa02_44a0_a3e2_a6fc3619a508.slice/crio-2ae80dbbd863bae9a26e12764cb309c166a6a9aa46b43be4beb9ae560eff1e98 WatchSource:0}: Error finding container 2ae80dbbd863bae9a26e12764cb309c166a6a9aa46b43be4beb9ae560eff1e98: Status 404 returned error can't find the container with id 2ae80dbbd863bae9a26e12764cb309c166a6a9aa46b43be4beb9ae560eff1e98 Jun 09 11:49:20.610635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:20.610491 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:20.686849 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:20.686814 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:21.075699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:21.075661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74b9cd9f-djmc4" event={"ID":"fc33757d-aa02-44a0-a3e2-a6fc3619a508","Type":"ContainerStarted","Data":"2ae80dbbd863bae9a26e12764cb309c166a6a9aa46b43be4beb9ae560eff1e98"} Jun 09 11:49:21.078190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:21.078155 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvmx2" event={"ID":"02602828-ed14-48f4-9704-636c406b5cf1","Type":"ContainerStarted","Data":"97c3aea00476b550343060b060f950f7c0f5e058dbdfa3603cbd42c5780bc67a"} Jun 09 11:49:22.010031 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.009939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:22.098896 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.098863 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6"] Jun 09 11:49:22.103685 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.103659 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.109049 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.108300 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jun 09 11:49:22.109049 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.108604 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 09 11:49:22.109049 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.108840 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 09 11:49:22.110244 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.109369 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 09 11:49:22.110244 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.109802 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jun 09 11:49:22.110244 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.110011 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-ztv9n\"" Jun 09 11:49:22.112058 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.111877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:22.117544 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.117511 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6"] Jun 09 11:49:22.191893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.191771 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2d26654-f2e2-409b-b940-c945ba43fd7c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.191893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.191855 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2thw\" (UniqueName: \"kubernetes.io/projected/e2d26654-f2e2-409b-b940-c945ba43fd7c-kube-api-access-w2thw\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.191893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.191884 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.192178 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.191914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.293269 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.293180 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2d26654-f2e2-409b-b940-c945ba43fd7c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.293269 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.293258 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2thw\" (UniqueName: \"kubernetes.io/projected/e2d26654-f2e2-409b-b940-c945ba43fd7c-kube-api-access-w2thw\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.293515 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.293289 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.293515 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.293319 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.293984 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:22.293913 2578 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-tls: secret "prometheus-operator-tls" not found Jun 09 11:49:22.293984 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:22.293985 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls podName:e2d26654-f2e2-409b-b940-c945ba43fd7c nodeName:}" failed. No retries permitted until 2026-06-09 11:49:22.79396621 +0000 UTC m=+241.874472134 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "prometheus-operator-tls" (UniqueName: "kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls") pod "prometheus-operator-7f7d445d84-nk4k6" (UID: "e2d26654-f2e2-409b-b940-c945ba43fd7c") : secret "prometheus-operator-tls" not found Jun 09 11:49:22.294879 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.294769 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e2d26654-f2e2-409b-b940-c945ba43fd7c-metrics-client-ca\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.301298 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.301225 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.307816 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.307770 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2thw\" (UniqueName: \"kubernetes.io/projected/e2d26654-f2e2-409b-b940-c945ba43fd7c-kube-api-access-w2thw\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.564522 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.564483 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:22.798742 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.798696 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:22.801947 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:22.801917 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/e2d26654-f2e2-409b-b940-c945ba43fd7c-prometheus-operator-tls\") pod \"prometheus-operator-7f7d445d84-nk4k6\" (UID: \"e2d26654-f2e2-409b-b940-c945ba43fd7c\") " pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:23.019748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:23.019655 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" Jun 09 11:49:23.395084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:23.394988 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6"] Jun 09 11:49:23.398534 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:23.398497 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2d26654_f2e2_409b_b940_c945ba43fd7c.slice/crio-f58a0abd23a624a14da329ae2077837eafa419492dc869a96b0d801d1278e142 WatchSource:0}: Error finding container f58a0abd23a624a14da329ae2077837eafa419492dc869a96b0d801d1278e142: Status 404 returned error can't find the container with id f58a0abd23a624a14da329ae2077837eafa419492dc869a96b0d801d1278e142 Jun 09 11:49:24.096020 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.095842 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74b9cd9f-djmc4" event={"ID":"fc33757d-aa02-44a0-a3e2-a6fc3619a508","Type":"ContainerStarted","Data":"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e"} Jun 09 11:49:24.098006 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.097740 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cd8cc9b-j5hvf" event={"ID":"071999ae-72bb-43de-881e-c1f5a8a07f2b","Type":"ContainerStarted","Data":"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047"} Jun 09 11:49:24.100978 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.100507 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zvmx2" event={"ID":"02602828-ed14-48f4-9704-636c406b5cf1","Type":"ContainerStarted","Data":"612ab61b9ce6ef7ba610719a31ce0775542efaabc00b633de8cb32b148b5f79f"} Jun 09 11:49:24.102014 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.101964 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" event={"ID":"e2d26654-f2e2-409b-b940-c945ba43fd7c","Type":"ContainerStarted","Data":"f58a0abd23a624a14da329ae2077837eafa419492dc869a96b0d801d1278e142"} Jun 09 11:49:24.117721 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.117352 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d74b9cd9f-djmc4" podStartSLOduration=2.23397459 podStartE2EDuration="5.117334646s" totalImagesPullingTime="2.883360056s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:24.11702914 +0000 UTC m=+243.197535094" watchObservedRunningTime="2026-06-09 11:49:24.117334646 +0000 UTC m=+243.197840574" Jun 09 11:49:24.139181 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.139098 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zvmx2" podStartSLOduration=2.014504947 podStartE2EDuration="6.139073782s" totalImagesPullingTime="4.124568835s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 11:49:18 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:24.137552841 +0000 UTC m=+243.218058797" watchObservedRunningTime="2026-06-09 11:49:24.139073782 +0000 UTC m=+243.219579708" Jun 09 11:49:24.160940 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.160876 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-f4cd8cc9b-j5hvf" podStartSLOduration=1.937145332 podStartE2EDuration="6.160853898s" totalImagesPullingTime="4.223708566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:24.159860395 +0000 UTC m=+243.240366323" watchObservedRunningTime="2026-06-09 11:49:24.160853898 +0000 UTC m=+243.241359826" Jun 09 11:49:24.955327 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:24.955240 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:25.108396 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:25.108349 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" event={"ID":"e2d26654-f2e2-409b-b940-c945ba43fd7c","Type":"ContainerStarted","Data":"10717e5107b029d2815235e007aa0a998c0f24a2737ce621110e096c63734664"} Jun 09 11:49:25.108627 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:25.108427 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" event={"ID":"e2d26654-f2e2-409b-b940-c945ba43fd7c","Type":"ContainerStarted","Data":"5fe231d7a3201feb617329ce02af6893fe8f9cafb073f8955248f771b7a4568d"} Jun 09 11:49:25.127932 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:25.127874 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-7f7d445d84-nk4k6" podStartSLOduration=1.9060544560000001 podStartE2EDuration="3.127852609s" totalImagesPullingTime="1.221798153s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:25.127517287 +0000 UTC m=+244.208023255" watchObservedRunningTime="2026-06-09 11:49:25.127852609 +0000 UTC m=+244.208358519" Jun 09 11:49:26.361699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:26.361658 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:26.462176 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:26.462142 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:27.214473 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.214440 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:27.385579 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.385546 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:27.478020 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.477936 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk"] Jun 09 11:49:27.481688 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.481052 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.481688 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.481188 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:27.483918 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.483710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 09 11:49:27.484059 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.484002 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 09 11:49:27.484357 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.484337 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-55nfw\"" Jun 09 11:49:27.495945 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.495120 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk"] Jun 09 11:49:27.528631 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.528585 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-6l6bf"] Jun 09 11:49:27.531453 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.531429 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.534094 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.534071 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-ltxjg\"" Jun 09 11:49:27.534300 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.534281 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 09 11:49:27.534535 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.534519 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 09 11:49:27.534746 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.534729 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 09 11:49:27.646918 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.646879 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647112 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.646927 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-root\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647112 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.646978 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647112 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647035 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.647112 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647076 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fb288d-7ac2-450d-9098-663e4316f866-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647113 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-sys\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647150 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-wtmp\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647167 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-metrics-client-ca\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647184 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647208 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-textfile\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647325 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647290 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lm2tz\" (UniqueName: \"kubernetes.io/projected/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-kube-api-access-lm2tz\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.647632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647344 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.647632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.647376 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-29b9v\" (UniqueName: \"kubernetes.io/projected/f5fb288d-7ac2-450d-9098-663e4316f866-kube-api-access-29b9v\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.748595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748502 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.748595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748555 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fb288d-7ac2-450d-9098-663e4316f866-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.748595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748590 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-sys\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748631 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-wtmp\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748653 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-metrics-client-ca\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748668 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748686 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-textfile\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:27.748689 2578 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748709 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lm2tz\" (UniqueName: \"kubernetes.io/projected/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-kube-api-access-lm2tz\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748735 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:27.748762 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls podName:f5fb288d-7ac2-450d-9098-663e4316f866 nodeName:}" failed. No retries permitted until 2026-06-09 11:49:28.248740865 +0000 UTC m=+247.329246783 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls") pod "openshift-state-metrics-65f78d5c66-xfnbk" (UID: "f5fb288d-7ac2-450d-9098-663e4316f866") : secret "openshift-state-metrics-tls" not found Jun 09 11:49:27.748876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748801 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-29b9v\" (UniqueName: \"kubernetes.io/projected/f5fb288d-7ac2-450d-9098-663e4316f866-kube-api-access-29b9v\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.749321 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748888 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.749321 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748918 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-root\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.749321 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.748959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.749321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:27.749065 2578 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 09 11:49:27.749321 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:27.749096 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls podName:e59d3bfc-9fb4-4430-9546-8d56a50fd05a nodeName:}" failed. No retries permitted until 2026-06-09 11:49:28.249085628 +0000 UTC m=+247.329591539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls") pod "node-exporter-6l6bf" (UID: "e59d3bfc-9fb4-4430-9546-8d56a50fd05a") : secret "node-exporter-tls" not found Jun 09 11:49:27.749603 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.749582 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-root\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.749663 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.749644 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-accelerators-collector-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.749891 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.749876 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-textfile\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.750122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.750103 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-metrics-client-ca\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.750310 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.750285 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-sys\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.750470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.750451 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-wtmp\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.750979 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.750929 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f5fb288d-7ac2-450d-9098-663e4316f866-metrics-client-ca\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.751771 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.751717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.753259 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.753235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.763119 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.762061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-29b9v\" (UniqueName: \"kubernetes.io/projected/f5fb288d-7ac2-450d-9098-663e4316f866-kube-api-access-29b9v\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:27.764816 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.764790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lm2tz\" (UniqueName: \"kubernetes.io/projected/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-kube-api-access-lm2tz\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:27.838763 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.838700 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:27.939893 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:27.939858 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.040393 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.040294 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.141619 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.141542 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.243067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.243025 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.253806 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.253770 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:28.253953 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.253819 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:28.256430 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.256391 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/e59d3bfc-9fb4-4430-9546-8d56a50fd05a-node-exporter-tls\") pod \"node-exporter-6l6bf\" (UID: \"e59d3bfc-9fb4-4430-9546-8d56a50fd05a\") " pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:28.256627 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.256609 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/f5fb288d-7ac2-450d-9098-663e4316f866-openshift-state-metrics-tls\") pod \"openshift-state-metrics-65f78d5c66-xfnbk\" (UID: \"f5fb288d-7ac2-450d-9098-663e4316f866\") " pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:28.395943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.395903 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" Jun 09 11:49:28.442915 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.442879 2578 patch_prober.go:28] interesting pod/image-registry-68b569b74f-bmnsv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:49:28.443085 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.442942 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:49:28.445101 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.445077 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-6l6bf" Jun 09 11:49:28.457472 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.457428 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.466070 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:28.466040 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59d3bfc_9fb4_4430_9546_8d56a50fd05a.slice/crio-f4d72e51edc9843f5afc5e51d170941a226d572f447200612d57759429a9ecfc WatchSource:0}: Error finding container f4d72e51edc9843f5afc5e51d170941a226d572f447200612d57759429a9ecfc: Status 404 returned error can't find the container with id f4d72e51edc9843f5afc5e51d170941a226d572f447200612d57759429a9ecfc Jun 09 11:49:28.533284 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.533230 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:28.539986 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.539642 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:49:28.543777 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.543753 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.548741 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549209 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549224 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549287 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549440 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549569 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549622 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549817 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vcs4q\"" Jun 09 11:49:28.549948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.549820 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 11:49:28.557009 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.556917 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:49:28.565776 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.564883 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk"] Jun 09 11:49:28.566972 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:28.566948 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5fb288d_7ac2_450d_9098_663e4316f866.slice/crio-ad2541355b2e0c2513c75a2e01396b6bd9f00261c16cb0db648be84d577d5a79 WatchSource:0}: Error finding container ad2541355b2e0c2513c75a2e01396b6bd9f00261c16cb0db648be84d577d5a79: Status 404 returned error can't find the container with id ad2541355b2e0c2513c75a2e01396b6bd9f00261c16cb0db648be84d577d5a79 Jun 09 11:49:28.658309 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658278 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658444 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658323 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kbmcm\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658502 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658436 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658502 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658491 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658592 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658524 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658592 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658560 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658692 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658593 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658692 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658658 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658729 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658834 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658778 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658834 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658803 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658940 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658849 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.658940 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.658895 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760198 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760251 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760283 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760315 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760383 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760453 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760493 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760538 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760599 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760644 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760691 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.760714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kbmcm\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:28.760778 2578 secret.go:189] Couldn't get secret openshift-monitoring/alertmanager-main-tls: secret "alertmanager-main-tls" not found Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:28.760858 2578 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls podName:8c66d95d-f9f7-4df1-a548-d4b75d0e208d nodeName:}" failed. No retries permitted until 2026-06-09 11:49:29.260839669 +0000 UTC m=+248.341345577 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "secret-alertmanager-main-tls" (UniqueName: "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls") pod "alertmanager-main-0" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d") : secret "alertmanager-main-tls" not found Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.761169 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.761346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.761246 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.762368 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.761818 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.765512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.765460 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.765983 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.765953 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.766510 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.766490 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.767057 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.767019 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.767573 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.767276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.767639 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.767610 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.767756 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.767730 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.768745 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.768722 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.770269 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.770235 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kbmcm\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:28.811074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.811038 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:28.811227 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.811107 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:28.812601 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.812576 2578 patch_prober.go:28] interesting pod/console-f4cd8cc9b-j5hvf container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" start-of-body= Jun 09 11:49:28.812728 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:28.812631 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-f4cd8cc9b-j5hvf" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerName="console" probeResult="failure" output="Get \"https://10.133.0.17:8443/health\": dial tcp 10.133.0.17:8443: connect: connection refused" Jun 09 11:49:29.115186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.115094 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:29.133487 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.133445 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l6bf" event={"ID":"e59d3bfc-9fb4-4430-9546-8d56a50fd05a","Type":"ContainerStarted","Data":"f4d72e51edc9843f5afc5e51d170941a226d572f447200612d57759429a9ecfc"} Jun 09 11:49:29.140512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.140474 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" event={"ID":"f5fb288d-7ac2-450d-9098-663e4316f866","Type":"ContainerStarted","Data":"72b682bd8dd7db341115de508a5f9d532310ebdc595420a86ed373fb3e463cce"} Jun 09 11:49:29.140682 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.140542 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" event={"ID":"f5fb288d-7ac2-450d-9098-663e4316f866","Type":"ContainerStarted","Data":"b363dde77c19f989a6445a674fd4f816de8aeac95c0806353ddc8ee449e5a091"} Jun 09 11:49:29.140682 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.140609 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" event={"ID":"f5fb288d-7ac2-450d-9098-663e4316f866","Type":"ContainerStarted","Data":"ad2541355b2e0c2513c75a2e01396b6bd9f00261c16cb0db648be84d577d5a79"} Jun 09 11:49:29.214965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.214906 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:29.266099 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.266055 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:29.269236 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.269204 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:29.315135 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.314986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:29.460221 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:29.460122 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:49:30.102794 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.102757 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:30.102978 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.102821 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:30.104302 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.104278 2578 patch_prober.go:28] interesting pod/console-7d74b9cd9f-djmc4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 09 11:49:30.104428 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.104333 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d74b9cd9f-djmc4" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 09 11:49:30.439470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.439318 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:30.510882 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.510848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:30.613567 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.613509 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:30.714718 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:30.714609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:32.248773 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.248678 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:32.249458 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.249431 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:32.282908 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.282876 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:49:32.286655 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.286634 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.294467 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.294369 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:49:32.324461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.324430 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:32.394654 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394621 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwfg\" (UniqueName: \"kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394858 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394675 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394858 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394740 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394858 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394818 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394866 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394933 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.394994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.394986 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.438097 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.438045 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:32.496042 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496007 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496053 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496093 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwfg\" (UniqueName: \"kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496127 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496151 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496208 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496534 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496254 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.496958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.496923 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.497093 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.497076 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.497287 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.497186 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.497287 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.497241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.498930 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.498874 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.499029 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.498976 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.504863 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.504840 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwfg\" (UniqueName: \"kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg\") pod \"console-684dddcffc-vrmf5\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:32.599254 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:32.599220 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:33.102286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.102245 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:49:33.104854 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.104827 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/b4c17869-8277-4de5-bf8e-f7c78f6e548b-metrics-certs\") pod \"network-metrics-daemon-wq7cp\" (UID: \"b4c17869-8277-4de5-bf8e-f7c78f6e548b\") " pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:49:33.341838 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.341805 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-t846k\"" Jun 09 11:49:33.349473 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.349449 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wq7cp" Jun 09 11:49:33.756852 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.756749 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:33.760915 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.760587 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:49:33.772487 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.771873 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.779631 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.778864 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 11:49:33.779778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.779643 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 11:49:33.779778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.779690 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 11:49:33.779778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.779739 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 11:49:33.779943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.779643 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 11:49:33.779943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.779933 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.780364 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.780436 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.780620 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.780671 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d0trns8qpt72v\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.780883 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.781003 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.781060 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.781225 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 11:49:33.782595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.781416 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fcdnn\"" Jun 09 11:49:33.783729 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.782968 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 11:49:33.784179 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.784084 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 11:49:33.799317 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.799281 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:49:33.809860 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.809833 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810012 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.809897 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810012 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.809984 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810128 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810022 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810128 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810059 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810128 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810086 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810235 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810132 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810235 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810174 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810254 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810281 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810308 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810331 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810366 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810387 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810552 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810585 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c58jp\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810624 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810677 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.810885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.810706 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.899037 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.898996 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:33.911524 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911524 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911523 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911739 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911679 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911739 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911714 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911857 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911739 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911857 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911762 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911857 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911787 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.911857 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.911815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912120 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912170 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912205 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c58jp\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912296 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912300 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912387 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912466 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912496 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912521 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912561 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.912611 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912588 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.913333 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.912627 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.913571 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914216 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914258 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914807 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914921 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914924 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.915468 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.914970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.916176 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.915761 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.916176 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.915812 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.917684 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.917121 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.917684 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.917643 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.918302 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.918276 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.918392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.918374 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.918466 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.918439 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.918748 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.918725 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.918839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.918760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.919236 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.919217 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:33.921604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:33.921562 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c58jp\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp\") pod \"prometheus-k8s-0\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:34.000865 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:34.000803 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:34.089483 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:34.089451 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:37.015420 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.015370 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:49:37.019283 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:37.019111 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c66d95d_f9f7_4df1_a548_d4b75d0e208d.slice/crio-c0373457c82d9d5de87a8251866d6188a60b86725e7cbfafc97cea09384e77b8 WatchSource:0}: Error finding container c0373457c82d9d5de87a8251866d6188a60b86725e7cbfafc97cea09384e77b8: Status 404 returned error can't find the container with id c0373457c82d9d5de87a8251866d6188a60b86725e7cbfafc97cea09384e77b8 Jun 09 11:49:37.028348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.028252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wq7cp"] Jun 09 11:49:37.031476 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.031451 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:49:37.031556 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:37.031454 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb4c17869_8277_4de5_bf8e_f7c78f6e548b.slice/crio-a99a9b9e50391c3ca5c09ae2edad58aa9e2e86463c3add998b96eaa5431f3d4d WatchSource:0}: Error finding container a99a9b9e50391c3ca5c09ae2edad58aa9e2e86463c3add998b96eaa5431f3d4d: Status 404 returned error can't find the container with id a99a9b9e50391c3ca5c09ae2edad58aa9e2e86463c3add998b96eaa5431f3d4d Jun 09 11:49:37.034642 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:37.034620 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcdbd0f03_513d_4393_9bc0_967318a2912e.slice/crio-33e771a4a625196a81c48104e3543eb601372fce2e89286f83769a677d4cd2f3 WatchSource:0}: Error finding container 33e771a4a625196a81c48104e3543eb601372fce2e89286f83769a677d4cd2f3: Status 404 returned error can't find the container with id 33e771a4a625196a81c48104e3543eb601372fce2e89286f83769a677d4cd2f3 Jun 09 11:49:37.068063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.068032 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:49:37.100798 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:49:37.100762 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod31dd39c5_264b_4f74_a9ce_385fac487488.slice/crio-de90479fc89742a542e78f72a7653967079b0dd2c0be469e91f2563d60373728 WatchSource:0}: Error finding container de90479fc89742a542e78f72a7653967079b0dd2c0be469e91f2563d60373728: Status 404 returned error can't find the container with id de90479fc89742a542e78f72a7653967079b0dd2c0be469e91f2563d60373728 Jun 09 11:49:37.181011 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.180982 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-6657875f97-mmjm5" event={"ID":"c2ee02bb-dab2-4454-91f3-b4095af7a261","Type":"ContainerStarted","Data":"239f8f7badcd1420dc849100f55a134bb455462ab25c72df65ce077399c0a767"} Jun 09 11:49:37.181284 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.181221 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:37.183087 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.183060 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dddcffc-vrmf5" event={"ID":"cdbd0f03-513d-4393-9bc0-967318a2912e","Type":"ContainerStarted","Data":"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931"} Jun 09 11:49:37.183206 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.183113 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dddcffc-vrmf5" event={"ID":"cdbd0f03-513d-4393-9bc0-967318a2912e","Type":"ContainerStarted","Data":"33e771a4a625196a81c48104e3543eb601372fce2e89286f83769a677d4cd2f3"} Jun 09 11:49:37.184830 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.184689 2578 generic.go:356] "Generic (PLEG): container finished" podID="e59d3bfc-9fb4-4430-9546-8d56a50fd05a" containerID="8950b304f8092624a62d8d5b269c3f16820b095e6668e6e6d543e38b25b80c82" exitCode=0 Jun 09 11:49:37.184830 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.184773 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l6bf" event={"ID":"e59d3bfc-9fb4-4430-9546-8d56a50fd05a","Type":"ContainerDied","Data":"8950b304f8092624a62d8d5b269c3f16820b095e6668e6e6d543e38b25b80c82"} Jun 09 11:49:37.186592 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.186562 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"de90479fc89742a542e78f72a7653967079b0dd2c0be469e91f2563d60373728"} Jun 09 11:49:37.188283 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.188259 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wq7cp" event={"ID":"b4c17869-8277-4de5-bf8e-f7c78f6e548b","Type":"ContainerStarted","Data":"a99a9b9e50391c3ca5c09ae2edad58aa9e2e86463c3add998b96eaa5431f3d4d"} Jun 09 11:49:37.191069 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.191050 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" event={"ID":"f5fb288d-7ac2-450d-9098-663e4316f866","Type":"ContainerStarted","Data":"8ec11f467bb028ba22ce7cc14b6c3480c8805a271842f87310e1ebecae8c2065"} Jun 09 11:49:37.191703 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.191683 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-6657875f97-mmjm5" Jun 09 11:49:37.192269 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.192251 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"c0373457c82d9d5de87a8251866d6188a60b86725e7cbfafc97cea09384e77b8"} Jun 09 11:49:37.212016 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.211639 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-6657875f97-mmjm5" podStartSLOduration=1.392958141 podStartE2EDuration="19.211617611s" totalImagesPullingTime="17.81865947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:37.209445333 +0000 UTC m=+256.289951263" watchObservedRunningTime="2026-06-09 11:49:37.211617611 +0000 UTC m=+256.292123540" Jun 09 11:49:37.232588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.232532 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-65f78d5c66-xfnbk" podStartSLOduration=2.121349158 podStartE2EDuration="10.232515784s" totalImagesPullingTime="8.111166626s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:37.230700556 +0000 UTC m=+256.311206510" watchObservedRunningTime="2026-06-09 11:49:37.232515784 +0000 UTC m=+256.313021710" Jun 09 11:49:37.258071 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:37.257868 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-684dddcffc-vrmf5" podStartSLOduration=5.257848091 podStartE2EDuration="5.257848091s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:37.256358501 +0000 UTC m=+256.336864429" watchObservedRunningTime="2026-06-09 11:49:37.257848091 +0000 UTC m=+256.338354019" Jun 09 11:49:38.204602 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:38.203796 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l6bf" event={"ID":"e59d3bfc-9fb4-4430-9546-8d56a50fd05a","Type":"ContainerStarted","Data":"d608e1f41510625a38d38a4e8534841f7baf9119565f6694bfefb6743bc06085"} Jun 09 11:49:38.204602 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:38.203877 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-6l6bf" event={"ID":"e59d3bfc-9fb4-4430-9546-8d56a50fd05a","Type":"ContainerStarted","Data":"a8ec58dbe561b2907c8d6972b31940561c98045c9bfcb558e5ea92d0a2c15ac9"} Jun 09 11:49:38.229636 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:38.229574 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-6l6bf" podStartSLOduration=2.787142836 podStartE2EDuration="11.229552231s" totalImagesPullingTime="8.351690149s" totalInitContainerRuntime="90.719246ms" isStatefulPod=true podCreationTimestamp="2026-06-09 11:49:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:38.227884572 +0000 UTC m=+257.308390521" watchObservedRunningTime="2026-06-09 11:49:38.229552231 +0000 UTC m=+257.310058159" Jun 09 11:49:38.443603 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:38.443554 2578 patch_prober.go:28] interesting pod/image-registry-68b569b74f-bmnsv container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 09 11:49:38.443773 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:38.443636 2578 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 09 11:49:39.071018 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:39.070929 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:39.190039 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:39.190001 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:40.102759 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.102718 2578 patch_prober.go:28] interesting pod/console-7d74b9cd9f-djmc4 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" start-of-body= Jun 09 11:49:40.103212 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.102783 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7d74b9cd9f-djmc4" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" probeResult="failure" output="Get \"https://10.133.0.18:8443/health\": dial tcp 10.133.0.18:8443: connect: connection refused" Jun 09 11:49:40.215203 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.215171 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" exitCode=0 Jun 09 11:49:40.215390 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.215265 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} Jun 09 11:49:40.218470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.218030 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wq7cp" event={"ID":"b4c17869-8277-4de5-bf8e-f7c78f6e548b","Type":"ContainerStarted","Data":"82a6af9641692375dcba54aa910f76298bbc7b663baf05dbe82990fdd878d484"} Jun 09 11:49:40.218470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.218177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wq7cp" event={"ID":"b4c17869-8277-4de5-bf8e-f7c78f6e548b","Type":"ContainerStarted","Data":"22fc0f9553cd52bacae877eb0f37d7917223fca9cf13b110b3e827e1d757b9e0"} Jun 09 11:49:40.219995 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.219969 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980" exitCode=0 Jun 09 11:49:40.220087 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.220018 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980"} Jun 09 11:49:40.299578 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.299517 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wq7cp" podStartSLOduration=257.047528124 podStartE2EDuration="4m19.2994965s" totalImagesPullingTime="2.251968376s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:45:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:40.298963485 +0000 UTC m=+259.379469433" watchObservedRunningTime="2026-06-09 11:49:40.2994965 +0000 UTC m=+259.380002426" Jun 09 11:49:40.489108 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.489020 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:40.637385 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:40.637342 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:42.600588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:42.600371 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:42.600588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:42.600462 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:42.604268 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:42.604208 2578 patch_prober.go:28] interesting pod/console-684dddcffc-vrmf5 container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" start-of-body= Jun 09 11:49:42.604268 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:42.604262 2578 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-684dddcffc-vrmf5" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerName="console" probeResult="failure" output="Get \"https://10.133.0.22:8443/health\": dial tcp 10.133.0.22:8443: connect: connection refused" Jun 09 11:49:43.240936 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:43.240895 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640"} Jun 09 11:49:43.241133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:43.241017 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d"} Jun 09 11:49:43.241133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:43.241061 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1"} Jun 09 11:49:43.446563 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:43.446522 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:43.456308 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:43.456266 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" containerID="cri-o://d5fdbab76bea4ee209e1d93c6a15885b71ff81bb2ecbad9893de53e8eb8d340f" gracePeriod=30 Jun 09 11:49:44.247460 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.247425 2578 generic.go:356] "Generic (PLEG): container finished" podID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerID="d5fdbab76bea4ee209e1d93c6a15885b71ff81bb2ecbad9893de53e8eb8d340f" exitCode=0 Jun 09 11:49:44.247460 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.247436 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" event={"ID":"403367f1-a6ac-4db7-a9c6-d2abce134d25","Type":"ContainerDied","Data":"d5fdbab76bea4ee209e1d93c6a15885b71ff81bb2ecbad9893de53e8eb8d340f"} Jun 09 11:49:44.451965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.451938 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:49:44.526961 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.526929 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527119 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.526972 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527119 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527119 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527057 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527119 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527095 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4dnb\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527355 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527175 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527355 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527221 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527355 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527286 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token\") pod \"403367f1-a6ac-4db7-a9c6-d2abce134d25\" (UID: \"403367f1-a6ac-4db7-a9c6-d2abce134d25\") " Jun 09 11:49:44.527536 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527357 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:49:44.527678 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527651 2578 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-certificates\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.527805 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.527785 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:49:44.530153 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.530105 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:49:44.530311 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.530279 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:49:44.530756 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.530729 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb" (OuterVolumeSpecName: "kube-api-access-w4dnb") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "kube-api-access-w4dnb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:49:44.531038 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.531001 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:49:44.531677 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.531646 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:49:44.542225 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.540258 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "403367f1-a6ac-4db7-a9c6-d2abce134d25" (UID: "403367f1-a6ac-4db7-a9c6-d2abce134d25"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:49:44.628955 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.628906 2578 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-image-registry-private-configuration\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.628955 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.628950 2578 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-registry-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.629190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.628971 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4dnb\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-kube-api-access-w4dnb\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.629190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.628984 2578 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/403367f1-a6ac-4db7-a9c6-d2abce134d25-ca-trust-extracted\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.629190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.628993 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/403367f1-a6ac-4db7-a9c6-d2abce134d25-trusted-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.629190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.629004 2578 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/403367f1-a6ac-4db7-a9c6-d2abce134d25-bound-sa-token\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:44.629190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:44.629016 2578 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/403367f1-a6ac-4db7-a9c6-d2abce134d25-installation-pull-secrets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:45.254262 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.254182 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" Jun 09 11:49:45.254262 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.254209 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-68b569b74f-bmnsv" event={"ID":"403367f1-a6ac-4db7-a9c6-d2abce134d25","Type":"ContainerDied","Data":"729fb35d9a59b6c5d304ea0f62ed68118a57371f4fa80de9af4ce7bdba9fa89d"} Jun 09 11:49:45.254877 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.254264 2578 scope.go:117] "RemoveContainer" containerID="d5fdbab76bea4ee209e1d93c6a15885b71ff81bb2ecbad9893de53e8eb8d340f" Jun 09 11:49:45.257060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.257034 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} Jun 09 11:49:45.257181 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.257117 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} Jun 09 11:49:45.261213 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.261187 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8"} Jun 09 11:49:45.261330 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.261256 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602"} Jun 09 11:49:45.279415 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.279370 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:49:45.282862 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.282830 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-68b569b74f-bmnsv"] Jun 09 11:49:45.344958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:45.344920 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" path="/var/lib/kubelet/pods/403367f1-a6ac-4db7-a9c6-d2abce134d25/volumes" Jun 09 11:49:47.278920 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:47.278886 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerStarted","Data":"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3"} Jun 09 11:49:47.307777 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:47.307722 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=13.274606744 podStartE2EDuration="19.307704372s" totalImagesPullingTime="6.003785853s" totalInitContainerRuntime="29.311775ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:28 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:47.305280746 +0000 UTC m=+266.385786707" watchObservedRunningTime="2026-06-09 11:49:47.307704372 +0000 UTC m=+266.388210335" Jun 09 11:49:48.286266 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:48.286167 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} Jun 09 11:49:48.286266 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:48.286240 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} Jun 09 11:49:48.286266 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:48.286266 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} Jun 09 11:49:48.286872 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:48.286290 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerStarted","Data":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} Jun 09 11:49:48.316359 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:48.316280 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=6.009800868 podStartE2EDuration="15.316259553s" totalImagesPullingTime="9.285669711s" totalInitContainerRuntime="20.788974ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:49:33 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:49:48.314843214 +0000 UTC m=+267.395349202" watchObservedRunningTime="2026-06-09 11:49:48.316259553 +0000 UTC m=+267.396765480" Jun 09 11:49:49.090045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:49.090009 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:49:50.106699 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.106666 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:50.110516 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.110489 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:49:50.278755 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.278713 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:50.348101 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.348066 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:50.613344 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.613307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:50.670586 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.670556 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:50.953312 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:50.953217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:52.074927 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.074890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:52.604513 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.604486 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:52.608236 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.608210 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:49:52.668439 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.668392 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:49:52.782603 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.782567 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:52.845595 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.845561 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:52.904927 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:52.904849 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:53.079210 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:53.079157 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:53.134330 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:53.134290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:56.808257 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:56.808201 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:56.916208 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:56.916175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:49:57.274429 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.274322 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-f4cd8cc9b-j5hvf" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerName="console" containerID="cri-o://a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047" gracePeriod=15 Jun 09 11:49:57.555201 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.555174 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:57.661833 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.661798 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.661833 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.661840 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.662044 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.661879 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.662044 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.661915 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92lv5\" (UniqueName: \"kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.662044 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.661986 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.662044 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.662037 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert\") pod \"071999ae-72bb-43de-881e-c1f5a8a07f2b\" (UID: \"071999ae-72bb-43de-881e-c1f5a8a07f2b\") " Jun 09 11:49:57.662284 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.662255 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca" (OuterVolumeSpecName: "service-ca") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:49:57.662348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.662285 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config" (OuterVolumeSpecName: "console-config") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:49:57.662507 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.662479 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:49:57.664253 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.664228 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:49:57.664536 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.664515 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:49:57.664594 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.664540 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5" (OuterVolumeSpecName: "kube-api-access-92lv5") pod "071999ae-72bb-43de-881e-c1f5a8a07f2b" (UID: "071999ae-72bb-43de-881e-c1f5a8a07f2b"). InnerVolumeSpecName "kube-api-access-92lv5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:49:57.763340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763302 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:57.763340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763334 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:57.763340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763346 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:57.763604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763354 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92lv5\" (UniqueName: \"kubernetes.io/projected/071999ae-72bb-43de-881e-c1f5a8a07f2b-kube-api-access-92lv5\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:57.763604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763363 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/071999ae-72bb-43de-881e-c1f5a8a07f2b-console-oauth-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:57.763604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:57.763372 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/071999ae-72bb-43de-881e-c1f5a8a07f2b-oauth-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:49:58.330591 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.330552 2578 generic.go:356] "Generic (PLEG): container finished" podID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerID="a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047" exitCode=0 Jun 09 11:49:58.330591 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.330598 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-f4cd8cc9b-j5hvf" Jun 09 11:49:58.331079 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.330641 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cd8cc9b-j5hvf" event={"ID":"071999ae-72bb-43de-881e-c1f5a8a07f2b","Type":"ContainerDied","Data":"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047"} Jun 09 11:49:58.331079 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.330692 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-f4cd8cc9b-j5hvf" event={"ID":"071999ae-72bb-43de-881e-c1f5a8a07f2b","Type":"ContainerDied","Data":"146a9d6cc7805dc67a698b973d565b629af163ee6209cda1bee456ac77e631ed"} Jun 09 11:49:58.331079 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.330714 2578 scope.go:117] "RemoveContainer" containerID="a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047" Jun 09 11:49:58.339228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.339208 2578 scope.go:117] "RemoveContainer" containerID="a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047" Jun 09 11:49:58.339495 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:49:58.339476 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047\": container with ID starting with a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047 not found: ID does not exist" containerID="a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047" Jun 09 11:49:58.339548 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.339504 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047"} err="failed to get container status \"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047\": rpc error: code = NotFound desc = could not find container \"a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047\": container with ID starting with a3e0934135f2f751068a1ad738ba233d2db7d7e1343d0c7c3e471e81f73ca047 not found: ID does not exist" Jun 09 11:49:58.351687 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.351661 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:58.355538 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:58.355518 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-f4cd8cc9b-j5hvf"] Jun 09 11:49:59.342718 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:49:59.342683 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" path="/var/lib/kubelet/pods/071999ae-72bb-43de-881e-c1f5a8a07f2b/volumes" Jun 09 11:50:01.345241 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:01.345204 2578 generic.go:356] "Generic (PLEG): container finished" podID="9c810dd6-518d-42ea-bcd1-f1195a3e8162" containerID="30f4002492590374f67ac7aec609fc9ded3e5c6a5bc14a11e4a72c2043e8923d" exitCode=0 Jun 09 11:50:01.345693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:01.345275 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" event={"ID":"9c810dd6-518d-42ea-bcd1-f1195a3e8162","Type":"ContainerDied","Data":"30f4002492590374f67ac7aec609fc9ded3e5c6a5bc14a11e4a72c2043e8923d"} Jun 09 11:50:01.345693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:01.345584 2578 scope.go:117] "RemoveContainer" containerID="30f4002492590374f67ac7aec609fc9ded3e5c6a5bc14a11e4a72c2043e8923d" Jun 09 11:50:02.351167 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:02.351126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-6bc5ff68f5-6d4rz" event={"ID":"9c810dd6-518d-42ea-bcd1-f1195a3e8162","Type":"ContainerStarted","Data":"94195d662468aa33a9cdbcb14dd889e3a0c26071db0f80af49353a82ac809be2"} Jun 09 11:50:02.809846 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:02.809798 2578 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-5vf7n" podUID="5c52b33d-e979-4e97-90fd-197a7d8739ca" Jun 09 11:50:03.355052 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:03.355017 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:03.681451 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:03.681345 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:03.735672 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:03.735638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:05.619967 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:05.619928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:05.716115 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:05.716082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:06.243735 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.243685 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:06.246097 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.246073 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/5c52b33d-e979-4e97-90fd-197a7d8739ca-metrics-tls\") pod \"dns-default-5vf7n\" (UID: \"5c52b33d-e979-4e97-90fd-197a7d8739ca\") " pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:06.358848 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.358813 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-z6m6l\"" Jun 09 11:50:06.366297 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.366272 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:06.368880 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.368856 2578 generic.go:356] "Generic (PLEG): container finished" podID="b91d017f-f098-47a4-94a1-5215375159f7" containerID="cefa9674eed6d16c77a3f00cafb5da23ec15e99515b7ce523fbcdc7362c9203b" exitCode=0 Jun 09 11:50:06.368977 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.368903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" event={"ID":"b91d017f-f098-47a4-94a1-5215375159f7","Type":"ContainerDied","Data":"cefa9674eed6d16c77a3f00cafb5da23ec15e99515b7ce523fbcdc7362c9203b"} Jun 09 11:50:06.369234 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.369217 2578 scope.go:117] "RemoveContainer" containerID="cefa9674eed6d16c77a3f00cafb5da23ec15e99515b7ce523fbcdc7362c9203b" Jun 09 11:50:06.509332 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:06.509308 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-5vf7n"] Jun 09 11:50:06.511744 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:50:06.511713 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c52b33d_e979_4e97_90fd_197a7d8739ca.slice/crio-45b270e3c65c6c98558bb6a13b9e59b2b6efd338e992f3cf0e16702d6181facd WatchSource:0}: Error finding container 45b270e3c65c6c98558bb6a13b9e59b2b6efd338e992f3cf0e16702d6181facd: Status 404 returned error can't find the container with id 45b270e3c65c6c98558bb6a13b9e59b2b6efd338e992f3cf0e16702d6181facd Jun 09 11:50:07.375610 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:07.375571 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-55bb7c4d49-pdrz8" event={"ID":"b91d017f-f098-47a4-94a1-5215375159f7","Type":"ContainerStarted","Data":"6817a41d32169bf3adb601a409f10ece7db25148c813bc1271d763b4586dcbcb"} Jun 09 11:50:07.377061 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:07.377037 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5vf7n" event={"ID":"5c52b33d-e979-4e97-90fd-197a7d8739ca","Type":"ContainerStarted","Data":"45b270e3c65c6c98558bb6a13b9e59b2b6efd338e992f3cf0e16702d6181facd"} Jun 09 11:50:08.476311 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:08.476270 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fv2r_72875ed7-85a7-46a1-989a-ad83cc45942e/dns-node-resolver/0.log" Jun 09 11:50:09.386653 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:09.386619 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5vf7n" event={"ID":"5c52b33d-e979-4e97-90fd-197a7d8739ca","Type":"ContainerStarted","Data":"7dd06f27bf0231c103691647cc6a67416eb2ba5c2f2d73c3c634058b6d8c5d7d"} Jun 09 11:50:09.386890 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:09.386673 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-5vf7n" event={"ID":"5c52b33d-e979-4e97-90fd-197a7d8739ca","Type":"ContainerStarted","Data":"8056ccf7a365e9c9b9cbe733f4be88974a400c1c51c71f7b80335a5c0a73de47"} Jun 09 11:50:09.386890 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:09.386717 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:09.406269 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:09.406206 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-5vf7n" podStartSLOduration=251.23943538 podStartE2EDuration="4m13.406186741s" totalImagesPullingTime="2.166751361s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:45:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:09.405378045 +0000 UTC m=+288.485884007" watchObservedRunningTime="2026-06-09 11:50:09.406186741 +0000 UTC m=+288.486692668" Jun 09 11:50:09.681346 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:09.681249 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sj7nx_e996d8a9-62a8-46c4-a678-2f471fd81ca6/serve-healthcheck-canary/0.log" Jun 09 11:50:12.785255 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:12.785217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:12.886335 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:12.886290 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:17.689101 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:17.689062 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d74b9cd9f-djmc4" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" containerID="cri-o://8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e" gracePeriod=15 Jun 09 11:50:17.975706 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:17.975678 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:50:18.039186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039156 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039210 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039266 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8lssp\" (UniqueName: \"kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039354 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039320 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039458 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039519 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039636 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039553 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config\") pod \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\" (UID: \"fc33757d-aa02-44a0-a3e2-a6fc3619a508\") " Jun 09 11:50:18.039682 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039655 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca" (OuterVolumeSpecName: "service-ca") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:18.039842 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039804 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:18.039923 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039825 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:18.039923 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.039873 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.040186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.040158 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config" (OuterVolumeSpecName: "console-config") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:18.041693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.041668 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:18.041812 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.041691 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:18.041905 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.041889 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp" (OuterVolumeSpecName: "kube-api-access-8lssp") pod "fc33757d-aa02-44a0-a3e2-a6fc3619a508" (UID: "fc33757d-aa02-44a0-a3e2-a6fc3619a508"). InnerVolumeSpecName "kube-api-access-8lssp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:50:18.141231 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141197 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8lssp\" (UniqueName: \"kubernetes.io/projected/fc33757d-aa02-44a0-a3e2-a6fc3619a508-kube-api-access-8lssp\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.141231 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141228 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-oauth-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.141448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141241 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.141448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141254 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.141448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141265 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-oauth-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.141448 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.141276 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fc33757d-aa02-44a0-a3e2-a6fc3619a508-console-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:18.424004 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.423970 2578 generic.go:356] "Generic (PLEG): container finished" podID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerID="8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e" exitCode=0 Jun 09 11:50:18.424004 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.424008 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d74b9cd9f-djmc4" Jun 09 11:50:18.424205 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.424046 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74b9cd9f-djmc4" event={"ID":"fc33757d-aa02-44a0-a3e2-a6fc3619a508","Type":"ContainerDied","Data":"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e"} Jun 09 11:50:18.424205 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.424098 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d74b9cd9f-djmc4" event={"ID":"fc33757d-aa02-44a0-a3e2-a6fc3619a508","Type":"ContainerDied","Data":"2ae80dbbd863bae9a26e12764cb309c166a6a9aa46b43be4beb9ae560eff1e98"} Jun 09 11:50:18.424205 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.424120 2578 scope.go:117] "RemoveContainer" containerID="8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e" Jun 09 11:50:18.433498 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.433481 2578 scope.go:117] "RemoveContainer" containerID="8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e" Jun 09 11:50:18.433791 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:18.433771 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e\": container with ID starting with 8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e not found: ID does not exist" containerID="8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e" Jun 09 11:50:18.433865 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.433806 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e"} err="failed to get container status \"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e\": rpc error: code = NotFound desc = could not find container \"8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e\": container with ID starting with 8388aa0a15e8de37aa31987db90d58f03c4629cbf36989a73ea8d4929d7b315e not found: ID does not exist" Jun 09 11:50:18.448453 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.448417 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:50:18.448621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:18.448471 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d74b9cd9f-djmc4"] Jun 09 11:50:19.346016 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:19.345780 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" path="/var/lib/kubelet/pods/fc33757d-aa02-44a0-a3e2-a6fc3619a508/volumes" Jun 09 11:50:19.392651 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:19.392623 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-5vf7n" Jun 09 11:50:20.613328 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:20.613295 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:20.712827 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:20.712793 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:21.296802 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:21.296775 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:50:21.298211 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:21.298187 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:50:21.312490 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:21.312462 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:50:21.313743 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:21.313723 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:50:21.316035 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:21.316020 2578 kubelet.go:1648] "Image garbage collection succeeded" Jun 09 11:50:27.346515 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:27.346486 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:27.447663 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:27.447628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:27.502973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:27.502934 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:28.511133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:28.511101 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:28.570382 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:28.570347 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:34.089774 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:34.089735 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:34.109356 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:34.109333 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:34.506479 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:34.506390 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:35.610288 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:35.610251 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:35.681939 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:35.681905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:37.528630 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:37.528593 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:37.594958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:37.594925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:46.747116 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:46.747077 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:46.945586 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:46.945551 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:47.807015 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.806978 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:47.807996 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.807960 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-metric" containerID="cri-o://5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" gracePeriod=120 Jun 09 11:50:47.808290 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.808263 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="config-reloader" containerID="cri-o://ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" gracePeriod=120 Jun 09 11:50:47.809551 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.808044 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy" containerID="cri-o://8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" gracePeriod=120 Jun 09 11:50:47.810218 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.808283 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="prom-label-proxy" containerID="cri-o://ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" gracePeriod=120 Jun 09 11:50:47.812659 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.808016 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-web" containerID="cri-o://a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" gracePeriod=120 Jun 09 11:50:47.812659 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:47.808529 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="alertmanager" containerID="cri-o://f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" gracePeriod=120 Jun 09 11:50:48.548959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.548920 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" exitCode=0 Jun 09 11:50:48.548959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.548949 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" exitCode=0 Jun 09 11:50:48.548959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.548956 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" exitCode=0 Jun 09 11:50:48.548959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.548963 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" exitCode=0 Jun 09 11:50:48.549286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.549001 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3"} Jun 09 11:50:48.549286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.549087 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602"} Jun 09 11:50:48.549286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.549126 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d"} Jun 09 11:50:48.549286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:48.549165 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1"} Jun 09 11:50:49.066596 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.066574 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.212772 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212675 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212772 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212730 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212772 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212814 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212879 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212918 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212946 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212970 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.212999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.212998 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213035 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213044 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213086 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kbmcm\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213116 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle\") pod \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\" (UID: \"8c66d95d-f9f7-4df1-a548-d4b75d0e208d\") " Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213342 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:49.213375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213359 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-main-db\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.213776 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.213756 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:49.216060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.216031 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.216378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.216349 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.216659 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.216619 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.216766 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.216676 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out" (OuterVolumeSpecName: "config-out") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:50:49.216839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.216806 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.217298 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.217271 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:50:49.217430 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.217308 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume" (OuterVolumeSpecName: "config-volume") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.217430 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.217355 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm" (OuterVolumeSpecName: "kube-api-access-kbmcm") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "kube-api-access-kbmcm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:50:49.220340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.220314 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.226800 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.226778 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config" (OuterVolumeSpecName: "web-config") pod "8c66d95d-f9f7-4df1-a548-d4b75d0e208d" (UID: "8c66d95d-f9f7-4df1-a548-d4b75d0e208d"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:49.314576 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314543 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kbmcm\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-kube-api-access-kbmcm\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314576 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314570 2578 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314576 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314580 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314589 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-main-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314600 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-out\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314609 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314631 2578 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-metrics-client-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314640 2578 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-config-volume\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314649 2578 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314659 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-web-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314667 2578 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-cluster-tls-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.314797 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.314675 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/8c66d95d-f9f7-4df1-a548-d4b75d0e208d-tls-assets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:49.555898 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555868 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" exitCode=0 Jun 09 11:50:49.555898 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555892 2578 generic.go:356] "Generic (PLEG): container finished" podID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerID="a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" exitCode=0 Jun 09 11:50:49.556082 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555912 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8"} Jun 09 11:50:49.556082 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555947 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.556082 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555967 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640"} Jun 09 11:50:49.556082 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.555994 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"8c66d95d-f9f7-4df1-a548-d4b75d0e208d","Type":"ContainerDied","Data":"c0373457c82d9d5de87a8251866d6188a60b86725e7cbfafc97cea09384e77b8"} Jun 09 11:50:49.556082 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.556023 2578 scope.go:117] "RemoveContainer" containerID="ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" Jun 09 11:50:49.564190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.564169 2578 scope.go:117] "RemoveContainer" containerID="5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" Jun 09 11:50:49.573242 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.573218 2578 scope.go:117] "RemoveContainer" containerID="8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" Jun 09 11:50:49.579782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.579766 2578 scope.go:117] "RemoveContainer" containerID="a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" Jun 09 11:50:49.587260 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.587241 2578 scope.go:117] "RemoveContainer" containerID="ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" Jun 09 11:50:49.587608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.587583 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:49.594340 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.594324 2578 scope.go:117] "RemoveContainer" containerID="f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" Jun 09 11:50:49.595368 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.595341 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:49.601742 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.601725 2578 scope.go:117] "RemoveContainer" containerID="d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980" Jun 09 11:50:49.608274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.608252 2578 scope.go:117] "RemoveContainer" containerID="ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" Jun 09 11:50:49.608572 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.608552 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3\": container with ID starting with ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3 not found: ID does not exist" containerID="ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" Jun 09 11:50:49.608637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.608580 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3"} err="failed to get container status \"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3\": rpc error: code = NotFound desc = could not find container \"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3\": container with ID starting with ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3 not found: ID does not exist" Jun 09 11:50:49.608637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.608598 2578 scope.go:117] "RemoveContainer" containerID="5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" Jun 09 11:50:49.608833 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.608812 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8\": container with ID starting with 5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8 not found: ID does not exist" containerID="5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" Jun 09 11:50:49.608899 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.608843 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8"} err="failed to get container status \"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8\": rpc error: code = NotFound desc = could not find container \"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8\": container with ID starting with 5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8 not found: ID does not exist" Jun 09 11:50:49.608899 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.608866 2578 scope.go:117] "RemoveContainer" containerID="8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" Jun 09 11:50:49.609093 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.609075 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602\": container with ID starting with 8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602 not found: ID does not exist" containerID="8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" Jun 09 11:50:49.609133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609099 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602"} err="failed to get container status \"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602\": rpc error: code = NotFound desc = could not find container \"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602\": container with ID starting with 8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602 not found: ID does not exist" Jun 09 11:50:49.609133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609114 2578 scope.go:117] "RemoveContainer" containerID="a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" Jun 09 11:50:49.609317 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.609292 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640\": container with ID starting with a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640 not found: ID does not exist" containerID="a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" Jun 09 11:50:49.609362 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609320 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640"} err="failed to get container status \"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640\": rpc error: code = NotFound desc = could not find container \"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640\": container with ID starting with a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640 not found: ID does not exist" Jun 09 11:50:49.609362 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609332 2578 scope.go:117] "RemoveContainer" containerID="ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" Jun 09 11:50:49.609548 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.609532 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d\": container with ID starting with ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d not found: ID does not exist" containerID="ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" Jun 09 11:50:49.609593 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609550 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d"} err="failed to get container status \"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d\": rpc error: code = NotFound desc = could not find container \"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d\": container with ID starting with ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d not found: ID does not exist" Jun 09 11:50:49.609593 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609568 2578 scope.go:117] "RemoveContainer" containerID="f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" Jun 09 11:50:49.609758 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.609741 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1\": container with ID starting with f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1 not found: ID does not exist" containerID="f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" Jun 09 11:50:49.609816 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609765 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1"} err="failed to get container status \"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1\": rpc error: code = NotFound desc = could not find container \"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1\": container with ID starting with f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1 not found: ID does not exist" Jun 09 11:50:49.609816 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.609785 2578 scope.go:117] "RemoveContainer" containerID="d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980" Jun 09 11:50:49.610005 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:49.609990 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980\": container with ID starting with d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980 not found: ID does not exist" containerID="d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980" Jun 09 11:50:49.610086 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610009 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980"} err="failed to get container status \"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980\": rpc error: code = NotFound desc = could not find container \"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980\": container with ID starting with d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980 not found: ID does not exist" Jun 09 11:50:49.610086 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610021 2578 scope.go:117] "RemoveContainer" containerID="ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3" Jun 09 11:50:49.610255 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610239 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3"} err="failed to get container status \"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3\": rpc error: code = NotFound desc = could not find container \"ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3\": container with ID starting with ed1e47a6b65788884e7aa4e21cebeacb64dac1b23f52370cec31923157674ec3 not found: ID does not exist" Jun 09 11:50:49.610255 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610254 2578 scope.go:117] "RemoveContainer" containerID="5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8" Jun 09 11:50:49.610486 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610470 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8"} err="failed to get container status \"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8\": rpc error: code = NotFound desc = could not find container \"5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8\": container with ID starting with 5d96321be0fe643764d1a1e197cd5af1096db075e3e865a2eb7c17c6222c8ec8 not found: ID does not exist" Jun 09 11:50:49.610541 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610487 2578 scope.go:117] "RemoveContainer" containerID="8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602" Jun 09 11:50:49.610701 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610682 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602"} err="failed to get container status \"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602\": rpc error: code = NotFound desc = could not find container \"8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602\": container with ID starting with 8cfa02e220aafcf171c1614b954db438de52096e5a426d059eb63734e035f602 not found: ID does not exist" Jun 09 11:50:49.610768 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610703 2578 scope.go:117] "RemoveContainer" containerID="a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640" Jun 09 11:50:49.610926 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610907 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640"} err="failed to get container status \"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640\": rpc error: code = NotFound desc = could not find container \"a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640\": container with ID starting with a7c0ba6cb9d78116b8ef4a2f98428f9160fc6f252383a1a98273bb34c182f640 not found: ID does not exist" Jun 09 11:50:49.610965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.610926 2578 scope.go:117] "RemoveContainer" containerID="ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d" Jun 09 11:50:49.611154 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.611138 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d"} err="failed to get container status \"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d\": rpc error: code = NotFound desc = could not find container \"ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d\": container with ID starting with ca281aa0e666f619f4e05030b0fcd6b8547e5d215bacacb2ebeec1b2e0b4451d not found: ID does not exist" Jun 09 11:50:49.611154 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.611154 2578 scope.go:117] "RemoveContainer" containerID="f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1" Jun 09 11:50:49.611368 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.611352 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1"} err="failed to get container status \"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1\": rpc error: code = NotFound desc = could not find container \"f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1\": container with ID starting with f2093bd52b6c4939d52d8d08d7a73d5f728720fe9db45c21dfac21bbb48cebc1 not found: ID does not exist" Jun 09 11:50:49.611434 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.611368 2578 scope.go:117] "RemoveContainer" containerID="d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980" Jun 09 11:50:49.611639 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.611624 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980"} err="failed to get container status \"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980\": rpc error: code = NotFound desc = could not find container \"d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980\": container with ID starting with d683930038e51ebcca973b756578863c8eacbe7f5f28b1c5ea44db01383f9980 not found: ID does not exist" Jun 09 11:50:49.629803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.629780 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:49.630083 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630071 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerName="console" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630085 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerName="console" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630096 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-metric" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630101 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-metric" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630109 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="init-config-reloader" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630115 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="init-config-reloader" Jun 09 11:50:49.630122 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630120 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="prom-label-proxy" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630127 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="prom-label-proxy" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630139 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630143 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630153 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="config-reloader" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630157 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="config-reloader" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630163 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630168 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630176 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630181 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630188 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="alertmanager" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630193 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="alertmanager" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630199 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-web" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630203 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-web" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630245 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="config-reloader" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630253 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="071999ae-72bb-43de-881e-c1f5a8a07f2b" containerName="console" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630258 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-metric" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630265 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc33757d-aa02-44a0-a3e2-a6fc3619a508" containerName="console" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630271 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="alertmanager" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630275 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy-web" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630281 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="kube-rbac-proxy" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630287 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="403367f1-a6ac-4db7-a9c6-d2abce134d25" containerName="registry" Jun 09 11:50:49.630291 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.630293 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" containerName="prom-label-proxy" Jun 09 11:50:49.633974 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.633958 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.636267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636216 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 09 11:50:49.636267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636232 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-vcs4q\"" Jun 09 11:50:49.636470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636277 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 09 11:50:49.636470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636302 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 09 11:50:49.636470 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636220 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 09 11:50:49.636680 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 09 11:50:49.636680 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 09 11:50:49.636827 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636710 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 09 11:50:49.636827 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.636727 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 09 11:50:49.642121 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.642104 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 09 11:50:49.653238 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.653216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:49.717602 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717570 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdvkr\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-kube-api-access-gdvkr\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717765 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717606 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717765 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717629 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717765 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717703 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-web-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717765 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717731 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717765 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-out\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717772 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717815 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717853 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717890 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.717925 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717914 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.718068 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717931 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.718068 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.717950 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818541 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818444 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-web-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818541 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818512 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818546 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-out\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818577 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818607 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818648 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818698 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.818747 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818732 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818759 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818791 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdvkr\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-kube-api-access-gdvkr\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818862 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.818892 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819297 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.819244 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.819632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.819581 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.821637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821606 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-web-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.821887 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821755 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.821887 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.821887 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821855 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-volume\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.822102 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821959 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/031eba6c-e786-4d54-b9b5-c2f050c64ddc-config-out\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.822102 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.821999 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.822395 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.822367 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.822518 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.822424 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/031eba6c-e786-4d54-b9b5-c2f050c64ddc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.823658 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.823634 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.823947 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.823927 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/031eba6c-e786-4d54-b9b5-c2f050c64ddc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.827114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.827093 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdvkr\" (UniqueName: \"kubernetes.io/projected/031eba6c-e786-4d54-b9b5-c2f050c64ddc-kube-api-access-gdvkr\") pod \"alertmanager-main-0\" (UID: \"031eba6c-e786-4d54-b9b5-c2f050c64ddc\") " pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:49.943784 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:49.943752 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 09 11:50:50.079729 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:50.079645 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 09 11:50:50.561337 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:50.561303 2578 generic.go:356] "Generic (PLEG): container finished" podID="031eba6c-e786-4d54-b9b5-c2f050c64ddc" containerID="58aa0f7ba8e178fe49700555e28541a4572d4dbe44a1a9e13b43748255c9f208" exitCode=0 Jun 09 11:50:50.561537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:50.561395 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerDied","Data":"58aa0f7ba8e178fe49700555e28541a4572d4dbe44a1a9e13b43748255c9f208"} Jun 09 11:50:50.561537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:50.561521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"ebdada5f7ae0055ae8da58b22b36a204f906c10f89e4d256dc26f74b5c4dcc05"} Jun 09 11:50:51.343811 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.343781 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c66d95d-f9f7-4df1-a548-d4b75d0e208d" path="/var/lib/kubelet/pods/8c66d95d-f9f7-4df1-a548-d4b75d0e208d/volumes" Jun 09 11:50:51.568764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568726 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"2ed14dbc93bd141e25124ac3b9a30c22d2a20fe546c1a341a18a8a368c9231da"} Jun 09 11:50:51.568958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568802 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"8018cad19d3ff47bcb68f3c5bbaa3c83f41c98340a5eddc1780a77fa0c9c1964"} Jun 09 11:50:51.568958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568845 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"5f9ffebe0dd22c4c14babbdaa88579daf60a56affdd9757ddc6966987b7f8336"} Jun 09 11:50:51.568958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568878 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"95be9e3aeeffd246c38eca168cfdb4212b80421bf8910a6ad148cc1fbc309001"} Jun 09 11:50:51.568958 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568919 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"e3a24c43011e2fe022ca105c5f98a624b99f8c87bd0ad8fff42206dd4ed7498a"} Jun 09 11:50:51.569170 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.568961 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"031eba6c-e786-4d54-b9b5-c2f050c64ddc","Type":"ContainerStarted","Data":"1b0bd3bbfe1a348b636d33460de2987ae0bc7efbcabb9e6ea5aeac1c8e5158f7"} Jun 09 11:50:51.595223 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.595031 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.577737666 podStartE2EDuration="2.59501107s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.273404ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:50:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:51.594657874 +0000 UTC m=+330.675163819" watchObservedRunningTime="2026-06-09 11:50:51.59501107 +0000 UTC m=+330.675516997" Jun 09 11:50:51.840003 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.839962 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-5b799b9f99-7pqdg"] Jun 09 11:50:51.843199 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.843179 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.846681 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846600 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jun 09 11:50:51.846681 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846652 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jun 09 11:50:51.846681 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846612 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jun 09 11:50:51.846921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846680 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jun 09 11:50:51.846921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846737 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jpqkm\"" Jun 09 11:50:51.846921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.846604 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jun 09 11:50:51.850242 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.850223 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jun 09 11:50:51.856417 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.856378 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b799b9f99-7pqdg"] Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939315 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939364 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939396 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939446 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-federate-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939467 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-metrics-client-ca\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939518 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8sfr6\" (UniqueName: \"kubernetes.io/projected/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-kube-api-access-8sfr6\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939547 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-serving-certs-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:51.939724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:51.939597 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040617 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040583 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8sfr6\" (UniqueName: \"kubernetes.io/projected/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-kube-api-access-8sfr6\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040625 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-serving-certs-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040662 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040704 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040724 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040755 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.040796 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040789 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-federate-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.041114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.040815 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-metrics-client-ca\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.041560 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.041493 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-serving-certs-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.041560 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.041536 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-metrics-client-ca\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.042065 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.042038 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-trusted-ca-bundle\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.043580 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.043554 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.043679 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.043658 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.044144 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.044123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-federate-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.044210 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.044123 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-telemeter-client-tls\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.049152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.049127 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8sfr6\" (UniqueName: \"kubernetes.io/projected/2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f-kube-api-access-8sfr6\") pod \"telemeter-client-5b799b9f99-7pqdg\" (UID: \"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f\") " pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.138473 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138356 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138760 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="prometheus" containerID="cri-o://00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" gracePeriod=600 Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138764 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy" containerID="cri-o://5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" gracePeriod=600 Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138823 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-web" containerID="cri-o://11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" gracePeriod=600 Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138801 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="config-reloader" containerID="cri-o://60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" gracePeriod=600 Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138915 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="thanos-sidecar" containerID="cri-o://6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" gracePeriod=600 Jun 09 11:50:52.138981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.138824 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-thanos" containerID="cri-o://a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" gracePeriod=600 Jun 09 11:50:52.155739 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.155710 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" Jun 09 11:50:52.353063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.353038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-5b799b9f99-7pqdg"] Jun 09 11:50:52.355801 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:50:52.355771 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f1f8998_2a1e_4e4f_b4d2_72ea80cf507f.slice/crio-6acb420e6c1b92a5ffe6a0ea2938e18062125b6d05a7a32ed9e22869acc1607c WatchSource:0}: Error finding container 6acb420e6c1b92a5ffe6a0ea2938e18062125b6d05a7a32ed9e22869acc1607c: Status 404 returned error can't find the container with id 6acb420e6c1b92a5ffe6a0ea2938e18062125b6d05a7a32ed9e22869acc1607c Jun 09 11:50:52.358031 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.358012 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:50:52.410808 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.410774 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.551813 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551773 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.551813 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551813 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551844 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551866 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551894 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551924 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551948 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.551980 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552045 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552069 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c58jp\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552105 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552141 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552217 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552255 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552296 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552273 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552303 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552347 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552422 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552480 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552528 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.552669 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552556 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"31dd39c5-264b-4f74-a9ce-385fac487488\" (UID: \"31dd39c5-264b-4f74-a9ce-385fac487488\") " Jun 09 11:50:52.553000 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552847 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.553000 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552866 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-metrics-client-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552299 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.552475 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.553616 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.554660 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out" (OuterVolumeSpecName: "config-out") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.554667 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.554745 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.554973 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.555321 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.555381 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.555575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.555466 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.556228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.555793 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.556228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.555881 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.556228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.556020 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp" (OuterVolumeSpecName: "kube-api-access-c58jp") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "kube-api-access-c58jp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:50:52.556228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.556164 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:50:52.557227 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.557208 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config" (OuterVolumeSpecName: "config") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.557508 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.557486 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.557724 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.557700 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.567356 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.567330 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config" (OuterVolumeSpecName: "web-config") pod "31dd39c5-264b-4f74-a9ce-385fac487488" (UID: "31dd39c5-264b-4f74-a9ce-385fac487488"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:50:52.574560 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.574535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" event={"ID":"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f","Type":"ContainerStarted","Data":"6acb420e6c1b92a5ffe6a0ea2938e18062125b6d05a7a32ed9e22869acc1607c"} Jun 09 11:50:52.577625 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577600 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" exitCode=0 Jun 09 11:50:52.577625 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577626 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" exitCode=0 Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577636 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" exitCode=0 Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577645 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" exitCode=0 Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577653 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" exitCode=0 Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577661 2578 generic.go:356] "Generic (PLEG): container finished" podID="31dd39c5-264b-4f74-a9ce-385fac487488" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" exitCode=0 Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577669 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577694 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.577752 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577730 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577759 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577800 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577808 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577836 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577860 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} Jun 09 11:50:52.578034 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.577885 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"31dd39c5-264b-4f74-a9ce-385fac487488","Type":"ContainerDied","Data":"de90479fc89742a542e78f72a7653967079b0dd2c0be469e91f2563d60373728"} Jun 09 11:50:52.586937 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.586921 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.594867 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.594851 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.601294 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.601277 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.605060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.605032 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:52.607965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.607940 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:52.609509 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.609484 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.616055 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.616035 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.623172 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.623143 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.629973 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.629950 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.630226 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.630207 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.630353 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630235 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.630353 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630253 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.630517 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.630499 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.630565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630520 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.630565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630534 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.630741 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.630727 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.630789 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630743 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.630789 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630754 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.630938 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.630925 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.630975 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630940 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.630975 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.630951 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.631157 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.631144 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.631191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631158 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.631191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631169 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.631378 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.631365 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.631447 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631381 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.631447 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631393 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.631637 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:50:52.631621 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.631691 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631640 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.631691 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631652 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.631861 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631845 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.631903 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.631860 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.632086 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632068 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.632120 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632086 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.632270 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632254 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.632310 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632271 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.632496 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632481 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.632541 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632496 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.632696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632682 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.632696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632696 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.632873 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632859 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.632873 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.632873 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.633094 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633073 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.633179 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633094 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.633302 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633284 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.633343 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633302 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.633518 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633502 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.633574 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633519 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.633723 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633703 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.633768 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633725 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.633943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633928 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.633985 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.633943 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.634149 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634128 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.634149 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634149 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.634537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634498 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.634537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634524 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.634863 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634803 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.634863 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.634830 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.635148 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635123 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.635148 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635148 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.635432 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635390 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.635528 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635433 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.635693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635669 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.635693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635691 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.635953 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635932 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.636018 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.635954 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.636198 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636181 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.636238 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636198 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.636447 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636427 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.636516 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636447 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.636553 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636510 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:52.636688 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636670 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.636731 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636689 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.636896 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636881 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="init-config-reloader" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636899 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="init-config-reloader" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636904 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636914 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="prometheus" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636917 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636920 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="prometheus" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636928 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="thanos-sidecar" Jun 09 11:50:52.636934 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636935 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="thanos-sidecar" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636941 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636947 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636957 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-web" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636962 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-web" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636969 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-thanos" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636974 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-thanos" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636981 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="config-reloader" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.636986 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="config-reloader" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637054 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="config-reloader" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637062 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="thanos-sidecar" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637068 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637074 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="prometheus" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637084 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-web" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637092 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" containerName="kube-rbac-proxy-thanos" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637134 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.637204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637147 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.637778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637349 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.637778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637361 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.637778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637589 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.637778 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637602 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.637921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637803 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.637921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.637816 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.638096 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638006 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.638096 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638024 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.638252 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638234 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.638297 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638254 2578 scope.go:117] "RemoveContainer" containerID="a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04" Jun 09 11:50:52.638498 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638481 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04"} err="failed to get container status \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": rpc error: code = NotFound desc = could not find container \"a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04\": container with ID starting with a5b2b415c029741acd09f75350de0a5f1b327d2b8e54f4eb4c3a92c689fe8b04 not found: ID does not exist" Jun 09 11:50:52.638498 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638497 2578 scope.go:117] "RemoveContainer" containerID="5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932" Jun 09 11:50:52.638715 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638691 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932"} err="failed to get container status \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": rpc error: code = NotFound desc = could not find container \"5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932\": container with ID starting with 5307da3f8ed1032895e92693936629a02fde9b0c4ba9501c69527b086a491932 not found: ID does not exist" Jun 09 11:50:52.638715 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638709 2578 scope.go:117] "RemoveContainer" containerID="11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6" Jun 09 11:50:52.638921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638900 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6"} err="failed to get container status \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": rpc error: code = NotFound desc = could not find container \"11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6\": container with ID starting with 11cf058704067cf5112306a53807ee8baf4183526f30afec90f3177b82f9e4e6 not found: ID does not exist" Jun 09 11:50:52.638921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.638918 2578 scope.go:117] "RemoveContainer" containerID="6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3" Jun 09 11:50:52.639129 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639111 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3"} err="failed to get container status \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": rpc error: code = NotFound desc = could not find container \"6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3\": container with ID starting with 6ad6e1e9bd3814836c410a0fad59560f87b918bd86406ee88df91b636555f2e3 not found: ID does not exist" Jun 09 11:50:52.639204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639131 2578 scope.go:117] "RemoveContainer" containerID="60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4" Jun 09 11:50:52.639380 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639364 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4"} err="failed to get container status \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": rpc error: code = NotFound desc = could not find container \"60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4\": container with ID starting with 60de7ada7a311a19b2214ef2bcc1a398015c14c6fd4abd158d6d9847c2f96fa4 not found: ID does not exist" Jun 09 11:50:52.639452 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639381 2578 scope.go:117] "RemoveContainer" containerID="00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0" Jun 09 11:50:52.639588 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639570 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0"} err="failed to get container status \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": rpc error: code = NotFound desc = could not find container \"00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0\": container with ID starting with 00c09a3535d536a6a1648d67490fdfd9ac9f819200c637b84ab957f90a128dd0 not found: ID does not exist" Jun 09 11:50:52.639657 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639589 2578 scope.go:117] "RemoveContainer" containerID="475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd" Jun 09 11:50:52.639795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639780 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.639848 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.639795 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd"} err="failed to get container status \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": rpc error: code = NotFound desc = could not find container \"475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd\": container with ID starting with 475bff308136728bb86bcf86a287fed5237362534d6a2a1a8e3644e19ef4d0dd not found: ID does not exist" Jun 09 11:50:52.642317 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642292 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 09 11:50:52.642317 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642313 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 09 11:50:52.642502 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642455 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 09 11:50:52.642667 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642641 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 09 11:50:52.642753 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642706 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 09 11:50:52.642811 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642763 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-d0trns8qpt72v\"" Jun 09 11:50:52.642878 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642860 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fcdnn\"" Jun 09 11:50:52.642935 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642917 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 09 11:50:52.642935 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642924 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 09 11:50:52.643037 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.642933 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 09 11:50:52.643267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.643248 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 09 11:50:52.643341 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.643249 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 09 11:50:52.643423 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.643371 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 09 11:50:52.643423 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.643395 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 09 11:50:52.643733 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.643716 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 09 11:50:52.645555 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.645534 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 09 11:50:52.648701 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.648684 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 09 11:50:52.653795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653752 2578 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-thanos-prometheus-http-client-file\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653772 2578 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653782 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653791 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653801 2578 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-metrics-client-certs\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653810 2578 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-kube-rbac-proxy\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653818 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653826 2578 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653835 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-db\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653842 2578 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-grpc-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653850 2578 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/31dd39c5-264b-4f74-a9ce-385fac487488-config-out\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653875 2578 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-web-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653884 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c58jp\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-kube-api-access-c58jp\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653891 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653899 2578 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/31dd39c5-264b-4f74-a9ce-385fac487488-tls-assets\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653909 2578 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/31dd39c5-264b-4f74-a9ce-385fac487488-secret-prometheus-k8s-tls\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653918 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.653989 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.653926 2578 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/31dd39c5-264b-4f74-a9ce-385fac487488-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:50:52.659071 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.659038 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:52.755110 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755069 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755110 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755109 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755364 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755241 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755364 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755321 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755525 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755369 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755525 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755395 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rh6nf\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-kube-api-access-rh6nf\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755525 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755506 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755679 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755563 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755679 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755587 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755679 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755623 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755723 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755753 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755774 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755791 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755807 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.755845 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755825 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.756074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755874 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.756074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755936 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.756074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.755983 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.756074 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.756029 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.856583 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.856539 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.856749 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.856589 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.856938 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.856913 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rh6nf\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-kube-api-access-rh6nf\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.856960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857019 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857155 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857063 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857155 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857097 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857155 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857155 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857148 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857171 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857218 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857243 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857275 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857277 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857305 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857347 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857422 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857462 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857486 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857710 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857516 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.857964 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.857727 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.860438 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.858267 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.860438 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.860074 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.861130 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.860509 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.861130 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.860628 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.861243 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.861156 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.861823 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.861504 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.861823 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.861720 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-web-config\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.862045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.861961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.862112 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.862049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.862357 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.862290 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.862357 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.862293 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/4b69e196-21c2-418d-96c0-03b785e5f8cb-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.862839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.862803 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/4b69e196-21c2-418d-96c0-03b785e5f8cb-config-out\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.863088 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.863064 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.863282 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.863242 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.863764 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.863739 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.864208 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.864187 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.865081 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.865061 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/4b69e196-21c2-418d-96c0-03b785e5f8cb-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.865940 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.865814 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rh6nf\" (UniqueName: \"kubernetes.io/projected/4b69e196-21c2-418d-96c0-03b785e5f8cb-kube-api-access-rh6nf\") pod \"prometheus-k8s-0\" (UID: \"4b69e196-21c2-418d-96c0-03b785e5f8cb\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:52.950801 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:52.950701 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:50:53.113100 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:53.113066 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 09 11:50:53.116183 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:50:53.116149 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b69e196_21c2_418d_96c0_03b785e5f8cb.slice/crio-3a53b81aa21b743dbba7979647cd056b3b453f2b4d11d939d2f95375b08277a4 WatchSource:0}: Error finding container 3a53b81aa21b743dbba7979647cd056b3b453f2b4d11d939d2f95375b08277a4: Status 404 returned error can't find the container with id 3a53b81aa21b743dbba7979647cd056b3b453f2b4d11d939d2f95375b08277a4 Jun 09 11:50:53.343292 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:53.343259 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="31dd39c5-264b-4f74-a9ce-385fac487488" path="/var/lib/kubelet/pods/31dd39c5-264b-4f74-a9ce-385fac487488/volumes" Jun 09 11:50:53.585551 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:53.585520 2578 generic.go:356] "Generic (PLEG): container finished" podID="4b69e196-21c2-418d-96c0-03b785e5f8cb" containerID="daaa68c47022e0f86c15d5e809ed6f26fdc261e9b19d96f40b9633a241c18bc1" exitCode=0 Jun 09 11:50:53.586007 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:53.585560 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerDied","Data":"daaa68c47022e0f86c15d5e809ed6f26fdc261e9b19d96f40b9633a241c18bc1"} Jun 09 11:50:53.586007 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:53.585625 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"3a53b81aa21b743dbba7979647cd056b3b453f2b4d11d939d2f95375b08277a4"} Jun 09 11:50:54.591998 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.591954 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" event={"ID":"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f","Type":"ContainerStarted","Data":"55a40708112b7d3ec6afd7999d9b9d009a0c64fe320e9da75416cdd92a342f8f"} Jun 09 11:50:54.592456 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.592026 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" event={"ID":"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f","Type":"ContainerStarted","Data":"ace38cc57340fd6b3e71efb66cdd6737c2a12e4ba293aad8a1cc454c89d16834"} Jun 09 11:50:54.592456 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.592052 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" event={"ID":"2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f","Type":"ContainerStarted","Data":"b291244d0c50291d13cd75e31b67194e8df56e986a2baff84b4f938dbe84b120"} Jun 09 11:50:54.595153 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595121 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"816d84dff459222fb58a670538d5a243f91c4c23cc98cdb072633d2c342fee27"} Jun 09 11:50:54.595274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595177 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"d3c62b0c844ff610f0704b5039cbff14a172c7de85b19eaf7ff4187795c3cae2"} Jun 09 11:50:54.595274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595220 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"b541de85d5a6d06ca1aff7ebbe30208234550cb5842a7f23b73dd8ce8d731c67"} Jun 09 11:50:54.595274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595255 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"0a2fc38c3f34c45908a3e1539a212af6bc72b91a1553c1d2edc52de07c70a328"} Jun 09 11:50:54.595387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595284 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"7df76bb8f5deccabcb657f947addabd0ee73aff73f3c105d588392ade5efdfa3"} Jun 09 11:50:54.595387 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.595317 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"4b69e196-21c2-418d-96c0-03b785e5f8cb","Type":"ContainerStarted","Data":"3aa9f4b10c641610267b6b8c2888fddbd2214ce383679675803019f3355d9153"} Jun 09 11:50:54.614801 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.614751 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-5b799b9f99-7pqdg" podStartSLOduration=1.926770094 podStartE2EDuration="3.614733444s" totalImagesPullingTime="1.68796335s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:50:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:54.613194666 +0000 UTC m=+333.693700634" watchObservedRunningTime="2026-06-09 11:50:54.614733444 +0000 UTC m=+333.695239370" Jun 09 11:50:54.643114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:54.643065 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.619911139 podStartE2EDuration="2.643047301s" totalImagesPullingTime="0s" totalInitContainerRuntime="23.136162ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:50:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:54.641504001 +0000 UTC m=+333.722009929" watchObservedRunningTime="2026-06-09 11:50:54.643047301 +0000 UTC m=+333.723553259" Jun 09 11:50:55.301902 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.301862 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:50:55.304753 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.304730 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.317100 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.317072 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:50:55.360962 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.360931 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:55.382833 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.382806 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.382988 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.382843 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-drv4w\" (UniqueName: \"kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.382988 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.382883 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.382988 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.382954 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.383158 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.383024 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.383158 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.383074 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.383158 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.383115 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.464032 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.463987 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:55.484191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484162 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484436 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484219 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484436 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484317 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484436 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484368 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484448 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-drv4w\" (UniqueName: \"kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.484604 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.484519 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.485104 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.485077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.485218 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.485077 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.485290 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.485268 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.485463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.485446 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.487335 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.487306 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.487472 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.487305 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.492717 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.492696 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-drv4w\" (UniqueName: \"kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w\") pod \"console-7c98cf4f75-smprm\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.560811 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.560726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:55.618128 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.618097 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:50:55.751231 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:55.751029 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:50:55.753154 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:50:55.753131 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod824308db_649c_481d_bf21_1e69a1d6c31e.slice/crio-eaffe739a44c9449265d076287e95f310be7af90641dc5d724c3c26d2084fb97 WatchSource:0}: Error finding container eaffe739a44c9449265d076287e95f310be7af90641dc5d724c3c26d2084fb97: Status 404 returned error can't find the container with id eaffe739a44c9449265d076287e95f310be7af90641dc5d724c3c26d2084fb97 Jun 09 11:50:56.100154 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:56.100123 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:56.155900 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:56.155822 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:50:56.606888 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:56.606849 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c98cf4f75-smprm" event={"ID":"824308db-649c-481d-bf21-1e69a1d6c31e","Type":"ContainerStarted","Data":"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b"} Jun 09 11:50:56.607057 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:56.606903 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c98cf4f75-smprm" event={"ID":"824308db-649c-481d-bf21-1e69a1d6c31e","Type":"ContainerStarted","Data":"eaffe739a44c9449265d076287e95f310be7af90641dc5d724c3c26d2084fb97"} Jun 09 11:50:56.623820 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:56.623771 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7c98cf4f75-smprm" podStartSLOduration=1.623757031 podStartE2EDuration="1.623757031s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:50:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:50:56.622486615 +0000 UTC m=+335.702992549" watchObservedRunningTime="2026-06-09 11:50:56.623757031 +0000 UTC m=+335.704262957" Jun 09 11:50:57.951114 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:50:57.951078 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:51:05.618784 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.618750 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:51:05.619268 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.618846 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:51:05.623565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.623545 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:51:05.649000 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.648975 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:51:05.694282 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.694216 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:51:05.795733 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.795695 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:51:05.844981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.844946 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:51:05.899163 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:05.899073 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:51:30.715979 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:30.715914 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-684dddcffc-vrmf5" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerName="console" containerID="cri-o://fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931" gracePeriod=15 Jun 09 11:51:30.964864 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:30.964843 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:51:31.101883 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.101840 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.101910 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbwfg\" (UniqueName: \"kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.101941 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.101992 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102017 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102073 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102335 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102100 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle\") pod \"cdbd0f03-513d-4393-9bc0-967318a2912e\" (UID: \"cdbd0f03-513d-4393-9bc0-967318a2912e\") " Jun 09 11:51:31.102601 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102563 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca" (OuterVolumeSpecName: "service-ca") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:51:31.102601 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102586 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config" (OuterVolumeSpecName: "console-config") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:51:31.102601 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102589 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:51:31.102807 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.102691 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:51:31.104133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.104110 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:51:31.104621 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.104601 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg" (OuterVolumeSpecName: "kube-api-access-mbwfg") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "kube-api-access-mbwfg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:51:31.104691 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.104619 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cdbd0f03-513d-4393-9bc0-967318a2912e" (UID: "cdbd0f03-513d-4393-9bc0-967318a2912e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:51:31.203258 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203219 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203258 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203250 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203258 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203261 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-oauth-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203258 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203270 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbwfg\" (UniqueName: \"kubernetes.io/projected/cdbd0f03-513d-4393-9bc0-967318a2912e-kube-api-access-mbwfg\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203566 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203279 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cdbd0f03-513d-4393-9bc0-967318a2912e-console-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203566 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203287 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-console-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.203566 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.203295 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cdbd0f03-513d-4393-9bc0-967318a2912e-oauth-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:51:31.766164 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.766123 2578 generic.go:356] "Generic (PLEG): container finished" podID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerID="fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931" exitCode=0 Jun 09 11:51:31.766660 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.766183 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-684dddcffc-vrmf5" Jun 09 11:51:31.766660 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.766215 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dddcffc-vrmf5" event={"ID":"cdbd0f03-513d-4393-9bc0-967318a2912e","Type":"ContainerDied","Data":"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931"} Jun 09 11:51:31.766660 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.766305 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-684dddcffc-vrmf5" event={"ID":"cdbd0f03-513d-4393-9bc0-967318a2912e","Type":"ContainerDied","Data":"33e771a4a625196a81c48104e3543eb601372fce2e89286f83769a677d4cd2f3"} Jun 09 11:51:31.766660 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.766332 2578 scope.go:117] "RemoveContainer" containerID="fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931" Jun 09 11:51:31.774655 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.774634 2578 scope.go:117] "RemoveContainer" containerID="fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931" Jun 09 11:51:31.774924 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:51:31.774903 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931\": container with ID starting with fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931 not found: ID does not exist" containerID="fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931" Jun 09 11:51:31.774999 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.774937 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931"} err="failed to get container status \"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931\": rpc error: code = NotFound desc = could not find container \"fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931\": container with ID starting with fe4b1c707dbd97260c87e501a4d5dc54d3c9a554566a0a5c1836b7d9548d4931 not found: ID does not exist" Jun 09 11:51:31.782338 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.782309 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:51:31.786186 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:31.786164 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-684dddcffc-vrmf5"] Jun 09 11:51:33.342703 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:33.342670 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" path="/var/lib/kubelet/pods/cdbd0f03-513d-4393-9bc0-967318a2912e/volumes" Jun 09 11:51:36.814336 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:36.814305 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:51:36.877236 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:36.877205 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:51:52.951707 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:52.951667 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:51:52.967551 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:52.967526 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:51:53.876931 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:51:53.876906 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 09 11:52:01.981773 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:01.981738 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:02.033063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:02.033033 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:03.852975 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.852934 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:52:03.853469 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.853324 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerName="console" Jun 09 11:52:03.853469 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.853339 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerName="console" Jun 09 11:52:03.853469 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.853431 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cdbd0f03-513d-4393-9bc0-967318a2912e" containerName="console" Jun 09 11:52:03.857635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.857613 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.866126 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.866102 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:52:03.934042 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.934006 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:03.979120 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979093 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979131 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979165 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979204 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9kb5c\" (UniqueName: \"kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979227 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979244 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.979488 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.979293 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:03.985962 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:03.985936 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:04.041104 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.041052 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:04.080174 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080147 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080306 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080177 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080306 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080201 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080306 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080233 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080306 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080259 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080306 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080294 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.080534 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.080312 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9kb5c\" (UniqueName: \"kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.081116 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.081082 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.081225 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.081087 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.081225 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.081218 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.081342 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.081241 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.082813 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.082783 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.082913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.082861 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.087750 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.087731 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9kb5c\" (UniqueName: \"kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c\") pod \"console-55f64b57cb-dts6d\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.168276 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.168211 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:04.295560 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.295539 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:52:04.297799 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:52:04.297770 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcfdbf188_5c8d_470c_8eac_a7f5815d69cf.slice/crio-7ef36f3913e58410ea7f83136e5526129bd936457608e8522d81385629d200ef WatchSource:0}: Error finding container 7ef36f3913e58410ea7f83136e5526129bd936457608e8522d81385629d200ef: Status 404 returned error can't find the container with id 7ef36f3913e58410ea7f83136e5526129bd936457608e8522d81385629d200ef Jun 09 11:52:04.856227 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.856176 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:04.907305 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.907272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:04.910876 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.910852 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f64b57cb-dts6d" event={"ID":"cfdbf188-5c8d-470c-8eac-a7f5815d69cf","Type":"ContainerStarted","Data":"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d"} Jun 09 11:52:04.911006 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.910900 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f64b57cb-dts6d" event={"ID":"cfdbf188-5c8d-470c-8eac-a7f5815d69cf","Type":"ContainerStarted","Data":"7ef36f3913e58410ea7f83136e5526129bd936457608e8522d81385629d200ef"} Jun 09 11:52:04.928063 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:04.928020 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f64b57cb-dts6d" podStartSLOduration=1.928006108 podStartE2EDuration="1.928006108s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:52:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:52:04.927161497 +0000 UTC m=+404.007667425" watchObservedRunningTime="2026-06-09 11:52:04.928006108 +0000 UTC m=+404.008512035" Jun 09 11:52:08.059615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:08.059578 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:13.855187 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:13.855153 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:13.904031 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:13.903997 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:14.168719 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:14.168639 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:14.168719 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:14.168701 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:14.173333 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:14.173309 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:14.961010 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:14.960986 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:52:15.004135 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:15.004106 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:52:15.131389 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:15.131354 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:15.193959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:15.193928 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:15.245378 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:15.245313 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:20.611682 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:20.611652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:20.711242 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:20.711208 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:20.771335 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:20.771307 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:52:40.024396 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.024289 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7c98cf4f75-smprm" podUID="824308db-649c-481d-bf21-1e69a1d6c31e" containerName="console" containerID="cri-o://11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b" gracePeriod=15 Jun 09 11:52:40.267146 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.267123 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:52:40.274582 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274534 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274674 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274587 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274776 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274758 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274848 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274833 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-drv4w\" (UniqueName: \"kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274896 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274870 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274904 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.274959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.274930 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca\") pod \"824308db-649c-481d-bf21-1e69a1d6c31e\" (UID: \"824308db-649c-481d-bf21-1e69a1d6c31e\") " Jun 09 11:52:40.275060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275002 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:52:40.275118 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275053 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config" (OuterVolumeSpecName: "console-config") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:52:40.275190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275176 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.275254 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275196 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-console-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.275322 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275301 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca" (OuterVolumeSpecName: "service-ca") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:52:40.275377 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.275299 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:52:40.276815 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.276784 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w" (OuterVolumeSpecName: "kube-api-access-drv4w") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "kube-api-access-drv4w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:52:40.276913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.276812 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:52:40.276913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.276836 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "824308db-649c-481d-bf21-1e69a1d6c31e" (UID: "824308db-649c-481d-bf21-1e69a1d6c31e"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:52:40.376383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.376349 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-drv4w\" (UniqueName: \"kubernetes.io/projected/824308db-649c-481d-bf21-1e69a1d6c31e-kube-api-access-drv4w\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.376383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.376376 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.376383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.376386 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-oauth-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.376623 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.376396 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/824308db-649c-481d-bf21-1e69a1d6c31e-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:40.376623 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:40.376422 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/824308db-649c-481d-bf21-1e69a1d6c31e-console-oauth-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:52:41.066736 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.066699 2578 generic.go:356] "Generic (PLEG): container finished" podID="824308db-649c-481d-bf21-1e69a1d6c31e" containerID="11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b" exitCode=0 Jun 09 11:52:41.067152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.066747 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7c98cf4f75-smprm" Jun 09 11:52:41.067152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.066789 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c98cf4f75-smprm" event={"ID":"824308db-649c-481d-bf21-1e69a1d6c31e","Type":"ContainerDied","Data":"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b"} Jun 09 11:52:41.067152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.066839 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7c98cf4f75-smprm" event={"ID":"824308db-649c-481d-bf21-1e69a1d6c31e","Type":"ContainerDied","Data":"eaffe739a44c9449265d076287e95f310be7af90641dc5d724c3c26d2084fb97"} Jun 09 11:52:41.067152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.066860 2578 scope.go:117] "RemoveContainer" containerID="11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b" Jun 09 11:52:41.075817 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.075800 2578 scope.go:117] "RemoveContainer" containerID="11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b" Jun 09 11:52:41.076081 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:52:41.076061 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b\": container with ID starting with 11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b not found: ID does not exist" containerID="11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b" Jun 09 11:52:41.076129 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.076089 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b"} err="failed to get container status \"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b\": rpc error: code = NotFound desc = could not find container \"11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b\": container with ID starting with 11dc6f51de392959ad60681930eb882c8ddf24f7c9d7caa1e9513abae5ec818b not found: ID does not exist" Jun 09 11:52:41.087040 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.087017 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:52:41.090540 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.090521 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7c98cf4f75-smprm"] Jun 09 11:52:41.347519 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:41.344526 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824308db-649c-481d-bf21-1e69a1d6c31e" path="/var/lib/kubelet/pods/824308db-649c-481d-bf21-1e69a1d6c31e/volumes" Jun 09 11:52:51.580304 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:52:51.580271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:10.629686 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:10.629651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:10.725555 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:10.725521 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:37.178988 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:37.178951 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:38.016375 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:38.016339 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:40.796126 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:40.796091 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:40.893766 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:40.893726 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:42.317308 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:42.317269 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:42.436027 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:42.435988 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:45.783229 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:45.783195 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:46.168329 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:46.168296 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:48.179452 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:48.179396 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:48.279545 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:48.279510 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:50.363158 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.363118 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s"] Jun 09 11:53:50.363572 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.363545 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824308db-649c-481d-bf21-1e69a1d6c31e" containerName="console" Jun 09 11:53:50.363572 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.363558 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="824308db-649c-481d-bf21-1e69a1d6c31e" containerName="console" Jun 09 11:53:50.363658 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.363611 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="824308db-649c-481d-bf21-1e69a1d6c31e" containerName="console" Jun 09 11:53:50.366514 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.366497 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.369030 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.369005 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jun 09 11:53:50.370045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.370023 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jun 09 11:53:50.370152 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.370033 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-f676t\"" Jun 09 11:53:50.373856 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.373734 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s"] Jun 09 11:53:50.486228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.486196 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5tqp\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-kube-api-access-p5tqp\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.486228 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.486231 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.587522 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.587490 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5tqp\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-kube-api-access-p5tqp\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.587693 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.587527 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.597450 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.597398 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-bound-sa-token\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.597575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.597477 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5tqp\" (UniqueName: \"kubernetes.io/projected/87d465df-e74d-4a62-9561-985360cb1318-kube-api-access-p5tqp\") pod \"cert-manager-webhook-7dc76cbb94-7bp2s\" (UID: \"87d465df-e74d-4a62-9561-985360cb1318\") " pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.686608 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.686525 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:50.815051 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:50.815026 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s"] Jun 09 11:53:50.816993 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:53:50.816970 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87d465df_e74d_4a62_9561_985360cb1318.slice/crio-d3fbd75f774f43b3709002f179eefe822a9ff598178aff5eb57bf27b811a9ecc WatchSource:0}: Error finding container d3fbd75f774f43b3709002f179eefe822a9ff598178aff5eb57bf27b811a9ecc: Status 404 returned error can't find the container with id d3fbd75f774f43b3709002f179eefe822a9ff598178aff5eb57bf27b811a9ecc Jun 09 11:53:51.370874 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:51.370843 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" event={"ID":"87d465df-e74d-4a62-9561-985360cb1318","Type":"ContainerStarted","Data":"d3fbd75f774f43b3709002f179eefe822a9ff598178aff5eb57bf27b811a9ecc"} Jun 09 11:53:53.380302 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:53.380266 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:58.768022 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:58.767983 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:58.819717 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:58.819679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:53:59.407393 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:59.407360 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" event={"ID":"87d465df-e74d-4a62-9561-985360cb1318","Type":"ContainerStarted","Data":"738db16e08ebb8dbb93e0876aca8e8da1c0542607ea1e451c89e14b915e1be07"} Jun 09 11:53:59.407565 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:59.407437 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:53:59.423937 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:53:59.423881 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" podStartSLOduration=1.7129489150000001 podStartE2EDuration="9.423867399s" totalImagesPullingTime="7.710918484s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:53:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:53:59.422676301 +0000 UTC m=+518.503182229" watchObservedRunningTime="2026-06-09 11:53:59.423867399 +0000 UTC m=+518.504373326" Jun 09 11:54:05.412872 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:05.412837 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-7dc76cbb94-7bp2s" Jun 09 11:54:09.310801 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:09.310717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:09.403941 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:09.403907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:14.678226 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:14.678185 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:14.778302 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:14.778271 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:16.902897 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:16.902844 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:21.141694 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.141645 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:21.182761 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.182725 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht"] Jun 09 11:54:21.186094 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.186065 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.188463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.188441 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:21.188640 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.188487 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 11:54:21.189307 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.189283 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 11:54:21.189496 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.189478 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 11:54:21.189584 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.189494 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-62ht6\"" Jun 09 11:54:21.189584 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.189523 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:21.197379 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.197351 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht"] Jun 09 11:54:21.220254 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.220220 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:21.263536 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.263504 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-metrics-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.263712 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.263549 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.263712 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.263605 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fvb2\" (UniqueName: \"kubernetes.io/projected/ad11a06d-a04a-4a49-af69-7a45d2d4324d-kube-api-access-5fvb2\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.263712 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.263651 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad11a06d-a04a-4a49-af69-7a45d2d4324d-manager-config\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.364935 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.364902 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad11a06d-a04a-4a49-af69-7a45d2d4324d-manager-config\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.365146 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.364952 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-metrics-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.365146 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.364979 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.365146 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.365011 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fvb2\" (UniqueName: \"kubernetes.io/projected/ad11a06d-a04a-4a49-af69-7a45d2d4324d-kube-api-access-5fvb2\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.368802 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.368775 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 09 11:54:21.369906 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.369888 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 09 11:54:21.372728 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.372708 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 09 11:54:21.375817 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.375790 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/ad11a06d-a04a-4a49-af69-7a45d2d4324d-manager-config\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.377803 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.377785 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-metrics-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.377977 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.377961 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ad11a06d-a04a-4a49-af69-7a45d2d4324d-cert\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.378827 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.378812 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 09 11:54:21.390045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.390021 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 09 11:54:21.399503 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.399426 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fvb2\" (UniqueName: \"kubernetes.io/projected/ad11a06d-a04a-4a49-af69-7a45d2d4324d-kube-api-access-5fvb2\") pod \"lws-controller-manager-5f79d99c7-mbxht\" (UID: \"ad11a06d-a04a-4a49-af69-7a45d2d4324d\") " pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.498630 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.498600 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-62ht6\"" Jun 09 11:54:21.506859 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.506832 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:21.644230 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:21.644205 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht"] Jun 09 11:54:21.647121 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:54:21.647083 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad11a06d_a04a_4a49_af69_7a45d2d4324d.slice/crio-90854a2d77886a0eb8f92f37837eb9a28f581489fdd5297819aa8f15c986e189 WatchSource:0}: Error finding container 90854a2d77886a0eb8f92f37837eb9a28f581489fdd5297819aa8f15c986e189: Status 404 returned error can't find the container with id 90854a2d77886a0eb8f92f37837eb9a28f581489fdd5297819aa8f15c986e189 Jun 09 11:54:22.335472 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:22.335433 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:22.505599 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:22.505564 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" event={"ID":"ad11a06d-a04a-4a49-af69-7a45d2d4324d","Type":"ContainerStarted","Data":"90854a2d77886a0eb8f92f37837eb9a28f581489fdd5297819aa8f15c986e189"} Jun 09 11:54:24.516062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:24.516022 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" event={"ID":"ad11a06d-a04a-4a49-af69-7a45d2d4324d","Type":"ContainerStarted","Data":"90d529560474b2157cc5ccb1c4034e23620ad3bce0105efab7b987500ac51ecd"} Jun 09 11:54:24.516500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:24.516142 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:24.535072 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:24.534980 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" podStartSLOduration=0.91564936 podStartE2EDuration="3.534963716s" totalImagesPullingTime="2.619314356s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:24.533640837 +0000 UTC m=+543.614146785" watchObservedRunningTime="2026-06-09 11:54:24.534963716 +0000 UTC m=+543.615469643" Jun 09 11:54:32.044663 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:32.044611 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:32.139846 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:32.139813 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:32.632257 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:32.632219 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:32.839575 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:32.839516 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:32.942593 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:32.942501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.001471 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.001385 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt"] Jun 09 11:54:33.006826 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.006805 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.009903 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.009873 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 09 11:54:33.009903 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.009885 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 09 11:54:33.010515 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.010501 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 09 11:54:33.010650 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.010635 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-pt6pr\"" Jun 09 11:54:33.017199 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.017177 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 09 11:54:33.028163 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.028140 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt"] Jun 09 11:54:33.072088 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.072045 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.072512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.072106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-manifests\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.072512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.072173 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.072512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.072215 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj4ph\" (UniqueName: \"kubernetes.io/projected/c450ab80-3e80-45c2-8097-92f2e7ced800-kube-api-access-kj4ph\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.072512 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.072236 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-tmp\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173323 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173284 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-tmp\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173505 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173336 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173505 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173386 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-manifests\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173505 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173443 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173505 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173471 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj4ph\" (UniqueName: \"kubernetes.io/projected/c450ab80-3e80-45c2-8097-92f2e7ced800-kube-api-access-kj4ph\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.173821 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.173799 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-manifests\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.175795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.175760 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c450ab80-3e80-45c2-8097-92f2e7ced800-tmp\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.175962 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.175857 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-webhook-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.176067 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.176049 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/c450ab80-3e80-45c2-8097-92f2e7ced800-apiservice-cert\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.183188 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.183159 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj4ph\" (UniqueName: \"kubernetes.io/projected/c450ab80-3e80-45c2-8097-92f2e7ced800-kube-api-access-kj4ph\") pod \"opendatahub-operator-controller-manager-f5778ccf7-t9jvt\" (UID: \"c450ab80-3e80-45c2-8097-92f2e7ced800\") " pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.217258 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.217177 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.317125 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.317092 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:33.321134 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.321104 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.416466 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.416422 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.450632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.450607 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt"] Jun 09 11:54:33.453589 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:54:33.453559 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc450ab80_3e80_45c2_8097_92f2e7ced800.slice/crio-8d2f25da2f2328d72ed26476884c1ebad2855fa60628d49dc5cf30306a5905aa WatchSource:0}: Error finding container 8d2f25da2f2328d72ed26476884c1ebad2855fa60628d49dc5cf30306a5905aa: Status 404 returned error can't find the container with id 8d2f25da2f2328d72ed26476884c1ebad2855fa60628d49dc5cf30306a5905aa Jun 09 11:54:33.516262 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.516175 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.555990 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.555958 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" event={"ID":"c450ab80-3e80-45c2-8097-92f2e7ced800","Type":"ContainerStarted","Data":"8d2f25da2f2328d72ed26476884c1ebad2855fa60628d49dc5cf30306a5905aa"} Jun 09 11:54:33.616769 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.616733 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:33.717676 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:33.717637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:35.523096 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:35.523067 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-5f79d99c7-mbxht" Jun 09 11:54:36.575363 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:36.575320 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" event={"ID":"c450ab80-3e80-45c2-8097-92f2e7ced800","Type":"ContainerStarted","Data":"9ba3436e8f24d514389077f35c3159b886161d81b0871d82393e6bdf40660493"} Jun 09 11:54:37.581191 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:37.581158 2578 generic.go:356] "Generic (PLEG): container finished" podID="c450ab80-3e80-45c2-8097-92f2e7ced800" containerID="9ba3436e8f24d514389077f35c3159b886161d81b0871d82393e6bdf40660493" exitCode=0 Jun 09 11:54:37.581637 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:37.581248 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" event={"ID":"c450ab80-3e80-45c2-8097-92f2e7ced800","Type":"ContainerDied","Data":"9ba3436e8f24d514389077f35c3159b886161d81b0871d82393e6bdf40660493"} Jun 09 11:54:38.588488 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:38.588458 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" event={"ID":"c450ab80-3e80-45c2-8097-92f2e7ced800","Type":"ContainerStarted","Data":"63b73f460b5fffb534283427ebb1d9419fdc63bd7ade10962e4eff796c559e1d"} Jun 09 11:54:38.588905 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:38.588593 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:38.609584 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:38.609528 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" podStartSLOduration=2.324408164 podStartE2EDuration="6.609513894s" totalImagesPullingTime="3.286955595s" totalInitContainerRuntime="998.150135ms" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:32 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:38.60701385 +0000 UTC m=+557.687519798" watchObservedRunningTime="2026-06-09 11:54:38.609513894 +0000 UTC m=+557.690019822" Jun 09 11:54:49.595770 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:49.595743 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-f5778ccf7-t9jvt" Jun 09 11:54:51.947713 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:51.947679 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:52.090660 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.090624 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:52.702130 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.702091 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5"] Jun 09 11:54:52.709350 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.709318 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.713696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.713669 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-dcbt5\"" Jun 09 11:54:52.713868 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.713827 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 09 11:54:52.713868 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.713863 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 09 11:54:52.713998 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.713935 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 09 11:54:52.714960 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.714939 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 09 11:54:52.726223 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.726193 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5"] Jun 09 11:54:52.848839 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.848792 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tls-certs\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.849048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.848852 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tmp\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.849048 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.848910 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhpvx\" (UniqueName: \"kubernetes.io/projected/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-kube-api-access-jhpvx\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.949691 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.949643 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tls-certs\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.950163 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.949708 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tmp\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.950163 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.949745 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhpvx\" (UniqueName: \"kubernetes.io/projected/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-kube-api-access-jhpvx\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.952728 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.952622 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tmp\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.952948 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.952928 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-tls-certs\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:52.958652 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:52.958624 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhpvx\" (UniqueName: \"kubernetes.io/projected/b6004faa-a8fd-4651-afe1-7a6c3af8aab8-kube-api-access-jhpvx\") pod \"kube-auth-proxy-7b6cb988c7-jxvv5\" (UID: \"b6004faa-a8fd-4651-afe1-7a6c3af8aab8\") " pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:53.019567 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.019535 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" Jun 09 11:54:53.154513 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.154471 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:53.168509 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.168479 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5"] Jun 09 11:54:53.170609 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:54:53.170584 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb6004faa_a8fd_4651_afe1_7a6c3af8aab8.slice/crio-11fdb0cab3f9fe5001888ba9458e6f49c9803893ec91c0a92033b189c87f29a8 WatchSource:0}: Error finding container 11fdb0cab3f9fe5001888ba9458e6f49c9803893ec91c0a92033b189c87f29a8: Status 404 returned error can't find the container with id 11fdb0cab3f9fe5001888ba9458e6f49c9803893ec91c0a92033b189c87f29a8 Jun 09 11:54:53.259094 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.258986 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:53.356113 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.356082 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:53.660972 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.660929 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" event={"ID":"b6004faa-a8fd-4651-afe1-7a6c3af8aab8","Type":"ContainerStarted","Data":"11fdb0cab3f9fe5001888ba9458e6f49c9803893ec91c0a92033b189c87f29a8"} Jun 09 11:54:53.700956 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.700922 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:53.873941 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:53.873902 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:54:56.679847 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:56.679807 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" event={"ID":"b6004faa-a8fd-4651-afe1-7a6c3af8aab8","Type":"ContainerStarted","Data":"76dba9a6050cb7fb3a07c76eadc3de3937a1f9fbbdf4992e6aa62db25d04e522"} Jun 09 11:54:56.696279 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:54:56.696202 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7b6cb988c7-jxvv5" podStartSLOduration=1.8995842779999998 podStartE2EDuration="4.696184079s" totalImagesPullingTime="2.796599801s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:54:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:54:56.695285958 +0000 UTC m=+575.775791884" watchObservedRunningTime="2026-06-09 11:54:56.696184079 +0000 UTC m=+575.776690018" Jun 09 11:55:02.761870 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:02.761834 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:02.875672 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:02.875635 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:03.176729 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:03.176689 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:03.294424 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:03.294365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:03.957147 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:03.957115 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:04.055694 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:04.055651 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:04.167655 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:04.167623 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:04.335596 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:04.335560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:06.208913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:06.208883 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:08.886909 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:08.886875 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:08.997045 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:08.997004 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:10.412638 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:10.412598 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:10.544967 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:10.544937 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:11.204855 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:11.204827 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:11.407359 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:11.407327 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.335348 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.335313 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:55:21.335865 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.335480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 11:55:21.345492 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.345465 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:55:21.346001 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.345984 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 11:55:21.572065 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.571971 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.657065 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.656980 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.807664 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.807621 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:21.912709 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:21.912616 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:22.078168 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:22.078127 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.274466 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:25.274397 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.370057 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:25.370011 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.577645 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:25.577609 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.787736 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:25.787692 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:25.891571 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:25.891479 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:26.247461 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:26.247365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:53.509943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:53.509847 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:53.566615 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:53.566576 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:53.688780 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:53.688737 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:54.437979 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:54.437949 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:54.637880 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:54.637848 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:55.432554 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:55.432499 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:55.486851 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:55.486817 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:59.436165 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.436135 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-677d7dbd4d-n8zzk"] Jun 09 11:55:59.438482 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.438466 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.452149 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.452125 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d7dbd4d-n8zzk"] Jun 09 11:55:59.493733 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.493686 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:59.546377 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.546341 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:55:59.577345 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577318 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ngc7\" (UniqueName: \"kubernetes.io/projected/85f6043f-b27d-489d-bdf4-72b4258a7a7a-kube-api-access-5ngc7\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577476 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577358 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-oauth-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577476 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577386 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577476 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577460 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577591 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577495 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-oauth-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577591 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577519 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-service-ca\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.577591 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.577551 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-trusted-ca-bundle\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.677988 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.677959 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-trusted-ca-bundle\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678143 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678006 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ngc7\" (UniqueName: \"kubernetes.io/projected/85f6043f-b27d-489d-bdf4-72b4258a7a7a-kube-api-access-5ngc7\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678143 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678123 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-oauth-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678168 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678196 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678224 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-oauth-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678267 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678242 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-service-ca\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.678906 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678883 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.679024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678967 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-trusted-ca-bundle\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.679024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678978 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-oauth-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.679024 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.678970 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/85f6043f-b27d-489d-bdf4-72b4258a7a7a-service-ca\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.680614 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.680587 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-serving-cert\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.680726 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.680702 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/85f6043f-b27d-489d-bdf4-72b4258a7a7a-console-oauth-config\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.686337 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.686283 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ngc7\" (UniqueName: \"kubernetes.io/projected/85f6043f-b27d-489d-bdf4-72b4258a7a7a-kube-api-access-5ngc7\") pod \"console-677d7dbd4d-n8zzk\" (UID: \"85f6043f-b27d-489d-bdf4-72b4258a7a7a\") " pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.749022 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.748991 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:55:59.878613 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.878585 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-677d7dbd4d-n8zzk"] Jun 09 11:55:59.880768 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:55:59.880726 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85f6043f_b27d_489d_bdf4_72b4258a7a7a.slice/crio-c1b01a5eef7d53752d726b4847fd570c9fbd5e41e2ec88cee25c5f0fff1067e8 WatchSource:0}: Error finding container c1b01a5eef7d53752d726b4847fd570c9fbd5e41e2ec88cee25c5f0fff1067e8: Status 404 returned error can't find the container with id c1b01a5eef7d53752d726b4847fd570c9fbd5e41e2ec88cee25c5f0fff1067e8 Jun 09 11:55:59.981500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.981414 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d7dbd4d-n8zzk" event={"ID":"85f6043f-b27d-489d-bdf4-72b4258a7a7a","Type":"ContainerStarted","Data":"218f214e6b9cdc913143e2812c74a008d2037e85f1ab400d7082dc787c172960"} Jun 09 11:55:59.981500 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.981483 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-677d7dbd4d-n8zzk" event={"ID":"85f6043f-b27d-489d-bdf4-72b4258a7a7a","Type":"ContainerStarted","Data":"c1b01a5eef7d53752d726b4847fd570c9fbd5e41e2ec88cee25c5f0fff1067e8"} Jun 09 11:55:59.998756 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:55:59.998713 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-677d7dbd4d-n8zzk" podStartSLOduration=0.998698454 podStartE2EDuration="998.698454ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:55:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:55:59.997636261 +0000 UTC m=+639.078142210" watchObservedRunningTime="2026-06-09 11:55:59.998698454 +0000 UTC m=+639.079204380" Jun 09 11:56:09.749801 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:09.749759 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:56:09.750292 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:09.749830 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:56:09.754681 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:09.754661 2578 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:56:10.031517 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:10.031439 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-677d7dbd4d-n8zzk" Jun 09 11:56:10.080315 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:10.080284 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:56:10.193984 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:10.193948 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:10.291726 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:10.291638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:10.392008 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:10.391974 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:13.518843 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:13.518783 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:16.733204 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:16.733172 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:17.504826 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:17.504792 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:19.195415 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:19.195379 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:19.312246 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:19.312215 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:21.373374 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:21.373336 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:23.878087 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:23.878053 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:25.055272 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:25.055233 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:26.553292 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:26.553264 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:27.255994 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:27.255962 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:28.555662 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.555635 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq"] Jun 09 11:56:28.558110 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.558091 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:28.562139 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.562118 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 09 11:56:28.562261 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.562206 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 09 11:56:28.563171 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.563154 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-wvz6v\"" Jun 09 11:56:28.572457 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.572435 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq"] Jun 09 11:56:28.654432 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.654370 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mbm8\" (UniqueName: \"kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8\") pod \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" (UID: \"9c0f0835-8975-4429-ad77-2f5c4a11a424\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:28.755383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.755344 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mbm8\" (UniqueName: \"kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8\") pod \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" (UID: \"9c0f0835-8975-4429-ad77-2f5c4a11a424\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:28.780558 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.780530 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mbm8\" (UniqueName: \"kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8\") pod \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" (UID: \"9c0f0835-8975-4429-ad77-2f5c4a11a424\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:28.868188 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:28.868095 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:29.032636 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:29.032605 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq"] Jun 09 11:56:29.035832 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:56:29.035802 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c0f0835_8975_4429_ad77_2f5c4a11a424.slice/crio-55057f59ba92720b4fc506879726a04237c48ff184ecb3d875668346fd2a6821 WatchSource:0}: Error finding container 55057f59ba92720b4fc506879726a04237c48ff184ecb3d875668346fd2a6821: Status 404 returned error can't find the container with id 55057f59ba92720b4fc506879726a04237c48ff184ecb3d875668346fd2a6821 Jun 09 11:56:29.037840 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:29.037822 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 11:56:29.114739 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:29.114703 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" event={"ID":"9c0f0835-8975-4429-ad77-2f5c4a11a424","Type":"ContainerStarted","Data":"55057f59ba92720b4fc506879726a04237c48ff184ecb3d875668346fd2a6821"} Jun 09 11:56:29.981836 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:29.981799 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:30.167109 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:30.167069 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:31.126421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:31.126370 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" event={"ID":"9c0f0835-8975-4429-ad77-2f5c4a11a424","Type":"ContainerStarted","Data":"54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b"} Jun 09 11:56:31.126756 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:31.126456 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:31.172478 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:31.172429 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" podStartSLOduration=1.172270002 podStartE2EDuration="3.172384494s" totalImagesPullingTime="2.000114492s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:56:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:31.171795601 +0000 UTC m=+670.252301528" watchObservedRunningTime="2026-06-09 11:56:31.172384494 +0000 UTC m=+670.252890422" Jun 09 11:56:35.106070 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.106011 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-55f64b57cb-dts6d" podUID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" containerName="console" containerID="cri-o://09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d" gracePeriod=15 Jun 09 11:56:35.354168 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.354136 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:56:35.454236 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.454152 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:35.533882 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.533849 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534070 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.533891 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9kb5c\" (UniqueName: \"kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534070 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.533938 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534070 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.533983 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534070 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534009 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534305 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534076 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534305 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534103 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle\") pod \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\" (UID: \"cfdbf188-5c8d-470c-8eac-a7f5815d69cf\") " Jun 09 11:56:35.534450 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534297 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config" (OuterVolumeSpecName: "console-config") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:56:35.534516 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534482 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:56:35.534654 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534623 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca" (OuterVolumeSpecName: "service-ca") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:56:35.534786 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.534701 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 11:56:35.536385 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.536351 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:56:35.536549 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.536422 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 11:56:35.536549 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.536436 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c" (OuterVolumeSpecName: "kube-api-access-9kb5c") pod "cfdbf188-5c8d-470c-8eac-a7f5815d69cf" (UID: "cfdbf188-5c8d-470c-8eac-a7f5815d69cf"). InnerVolumeSpecName "kube-api-access-9kb5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:56:35.634965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.634920 2578 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-oauth-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.634965 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.634961 2578 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-service-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.635184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.634976 2578 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-trusted-ca-bundle\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.635184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.634990 2578 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-config\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.635184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.635005 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9kb5c\" (UniqueName: \"kubernetes.io/projected/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-kube-api-access-9kb5c\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.635184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.635018 2578 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-console-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.635184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.635033 2578 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/cfdbf188-5c8d-470c-8eac-a7f5815d69cf-oauth-serving-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:35.673304 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.673272 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:35.884113 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.884075 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:35.992635 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:35.992587 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:36.107253 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.107217 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:36.153190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.153106 2578 generic.go:356] "Generic (PLEG): container finished" podID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" containerID="09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d" exitCode=0 Jun 09 11:56:36.153190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.153152 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f64b57cb-dts6d" Jun 09 11:56:36.153190 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.153161 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f64b57cb-dts6d" event={"ID":"cfdbf188-5c8d-470c-8eac-a7f5815d69cf","Type":"ContainerDied","Data":"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d"} Jun 09 11:56:36.153456 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.153198 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f64b57cb-dts6d" event={"ID":"cfdbf188-5c8d-470c-8eac-a7f5815d69cf","Type":"ContainerDied","Data":"7ef36f3913e58410ea7f83136e5526129bd936457608e8522d81385629d200ef"} Jun 09 11:56:36.153456 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.153217 2578 scope.go:117] "RemoveContainer" containerID="09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d" Jun 09 11:56:36.162824 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.162809 2578 scope.go:117] "RemoveContainer" containerID="09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d" Jun 09 11:56:36.163066 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:36.163049 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d\": container with ID starting with 09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d not found: ID does not exist" containerID="09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d" Jun 09 11:56:36.163110 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.163073 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d"} err="failed to get container status \"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d\": rpc error: code = NotFound desc = could not find container \"09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d\": container with ID starting with 09a6d0e5d0d901b30f7a39ca87469627240387f2902a8867e36881359c4f5d3d not found: ID does not exist" Jun 09 11:56:36.211733 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.211699 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:56:36.219959 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:36.219931 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f64b57cb-dts6d"] Jun 09 11:56:37.343630 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:37.343591 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" path="/var/lib/kubelet/pods/cfdbf188-5c8d-470c-8eac-a7f5815d69cf/volumes" Jun 09 11:56:39.356618 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:39.356582 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:39.455025 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:39.454989 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:40.919794 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:40.919755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:42.133397 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:42.133369 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:46.208294 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.208261 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq"] Jun 09 11:56:46.208704 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.208578 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" containerName="manager" containerID="cri-o://54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b" gracePeriod=2 Jun 09 11:56:46.225140 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.225115 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq"] Jun 09 11:56:46.239784 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:46.239749 2578 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"9c0f0835-8975-4429-ad77-2f5c4a11a424\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-kw6gq\": pods \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:46.266277 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266246 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d"] Jun 09 11:56:46.266716 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266693 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" containerName="console" Jun 09 11:56:46.266874 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266798 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" containerName="console" Jun 09 11:56:46.266874 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266834 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" containerName="manager" Jun 09 11:56:46.266874 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266843 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" containerName="manager" Jun 09 11:56:46.267028 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266977 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="cfdbf188-5c8d-470c-8eac-a7f5815d69cf" containerName="console" Jun 09 11:56:46.267028 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.266989 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" containerName="manager" Jun 09 11:56:46.270023 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.270002 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:46.277013 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:46.276985 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:46.287352 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.287323 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:46.328464 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.328435 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d"] Jun 09 11:56:46.328799 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.328784 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4pkx\" (UniqueName: \"kubernetes.io/projected/ba8a0227-4fba-4419-b60f-3c7eb0981a87-kube-api-access-w4pkx\") pod \"limitador-operator-controller-manager-859d7b78bd-nmw7d\" (UID: \"ba8a0227-4fba-4419-b60f-3c7eb0981a87\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:46.429349 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.429308 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4pkx\" (UniqueName: \"kubernetes.io/projected/ba8a0227-4fba-4419-b60f-3c7eb0981a87-kube-api-access-w4pkx\") pod \"limitador-operator-controller-manager-859d7b78bd-nmw7d\" (UID: \"ba8a0227-4fba-4419-b60f-3c7eb0981a87\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:46.444195 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.444171 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4pkx\" (UniqueName: \"kubernetes.io/projected/ba8a0227-4fba-4419-b60f-3c7eb0981a87-kube-api-access-w4pkx\") pod \"limitador-operator-controller-manager-859d7b78bd-nmw7d\" (UID: \"ba8a0227-4fba-4419-b60f-3c7eb0981a87\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:46.460421 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.460356 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:46.462781 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:46.462753 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:46.503940 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.503904 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:46.529921 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.529893 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mbm8\" (UniqueName: \"kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8\") pod \"9c0f0835-8975-4429-ad77-2f5c4a11a424\" (UID: \"9c0f0835-8975-4429-ad77-2f5c4a11a424\") " Jun 09 11:56:46.531987 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.531965 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8" (OuterVolumeSpecName: "kube-api-access-5mbm8") pod "9c0f0835-8975-4429-ad77-2f5c4a11a424" (UID: "9c0f0835-8975-4429-ad77-2f5c4a11a424"). InnerVolumeSpecName "kube-api-access-5mbm8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:56:46.601184 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.601155 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:46.631491 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.631461 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mbm8\" (UniqueName: \"kubernetes.io/projected/9c0f0835-8975-4429-ad77-2f5c4a11a424-kube-api-access-5mbm8\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:56:46.753557 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:46.753529 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d"] Jun 09 11:56:46.755743 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:56:46.755717 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba8a0227_4fba_4419_b60f_3c7eb0981a87.slice/crio-280b2fe2092c86ea2d9d402dc586e60bc2f26fa03a45e87c09feb8f3a8e2cd67 WatchSource:0}: Error finding container 280b2fe2092c86ea2d9d402dc586e60bc2f26fa03a45e87c09feb8f3a8e2cd67: Status 404 returned error can't find the container with id 280b2fe2092c86ea2d9d402dc586e60bc2f26fa03a45e87c09feb8f3a8e2cd67 Jun 09 11:56:47.213491 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.213452 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" event={"ID":"ba8a0227-4fba-4419-b60f-3c7eb0981a87","Type":"ContainerStarted","Data":"c97197ebf1012869d518ac498524cf427b3d800bf246eb150aed28ede6adadae"} Jun 09 11:56:47.213913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.213508 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" event={"ID":"ba8a0227-4fba-4419-b60f-3c7eb0981a87","Type":"ContainerStarted","Data":"280b2fe2092c86ea2d9d402dc586e60bc2f26fa03a45e87c09feb8f3a8e2cd67"} Jun 09 11:56:47.213913 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.213553 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:47.214790 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.214766 2578 generic.go:356] "Generic (PLEG): container finished" podID="9c0f0835-8975-4429-ad77-2f5c4a11a424" containerID="54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b" exitCode=0 Jun 09 11:56:47.214910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.214804 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:47.214910 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.214823 2578 scope.go:117] "RemoveContainer" containerID="54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b" Jun 09 11:56:47.217631 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:47.217605 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:47.229171 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.229152 2578 scope.go:117] "RemoveContainer" containerID="54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b" Jun 09 11:56:47.229517 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:47.229493 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b\": container with ID starting with 54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b not found: ID does not exist" containerID="54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b" Jun 09 11:56:47.229594 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.229536 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b"} err="failed to get container status \"54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b\": rpc error: code = NotFound desc = could not find container \"54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b\": container with ID starting with 54a89f97d7fe27b526dd1f3ff0ed58a9fd23e0b1756e154b055318758063e73b not found: ID does not exist" Jun 09 11:56:47.251153 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.251105 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" podStartSLOduration=1.2510916779999999 podStartE2EDuration="1.251091678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:56:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:56:47.248857185 +0000 UTC m=+686.329363190" watchObservedRunningTime="2026-06-09 11:56:47.251091678 +0000 UTC m=+686.331597605" Jun 09 11:56:47.254439 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:56:47.254416 2578 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-kw6gq\" is forbidden: User \"system:node:ip-10-0-128-244.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-244.ec2.internal' and this object" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-kw6gq" Jun 09 11:56:47.343847 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:47.343812 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c0f0835-8975-4429-ad77-2f5c4a11a424" path="/var/lib/kubelet/pods/9c0f0835-8975-4429-ad77-2f5c4a11a424/volumes" Jun 09 11:56:48.774946 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:48.774905 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:48.886736 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:48.886696 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:54.049506 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:54.049453 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:54.209550 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:54.209518 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:54.304084 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:54.303991 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:54.585057 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:54.584964 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:54.738647 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:54.738613 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:58.145464 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:58.145425 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:56:58.222392 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:58.222362 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nmw7d" Jun 09 11:56:58.263062 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:56:58.263031 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:03.890986 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:03.890955 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:03.986782 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:03.986750 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:04.434133 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:04.434093 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:04.520149 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:04.520113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:04.781158 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:04.781071 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:04.888217 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:04.888186 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:32.533286 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:32.533248 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:32.727529 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:32.727431 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:36.137632 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:36.137599 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:37.937772 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:37.937728 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:38.026880 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.026841 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:38.290907 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.290831 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 11:57:38.295703 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.295682 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.298976 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.298957 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vfpdg\"" Jun 09 11:57:38.299090 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.298957 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 09 11:57:38.305263 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.305234 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 11:57:38.352652 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.352627 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 11:57:38.411489 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.411461 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pf4pc\" (UniqueName: \"kubernetes.io/projected/1f57de66-7bdb-4941-8e6a-fc16c71af79b-kube-api-access-pf4pc\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.411627 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.411515 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f57de66-7bdb-4941-8e6a-fc16c71af79b-config-file\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.512263 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.512234 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pf4pc\" (UniqueName: \"kubernetes.io/projected/1f57de66-7bdb-4941-8e6a-fc16c71af79b-kube-api-access-pf4pc\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.512447 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.512314 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f57de66-7bdb-4941-8e6a-fc16c71af79b-config-file\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.512915 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.512896 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/1f57de66-7bdb-4941-8e6a-fc16c71af79b-config-file\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.520865 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.520843 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pf4pc\" (UniqueName: \"kubernetes.io/projected/1f57de66-7bdb-4941-8e6a-fc16c71af79b-kube-api-access-pf4pc\") pod \"limitador-limitador-54d6d988d5-hs7hj\" (UID: \"1f57de66-7bdb-4941-8e6a-fc16c71af79b\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.606544 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.606516 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:38.732825 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.732795 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:38.736389 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.736373 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:38.738885 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.738865 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j8hg2\"" Jun 09 11:57:38.745943 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.745922 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:38.749240 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.749216 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 11:57:38.751187 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:57:38.751162 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f57de66_7bdb_4941_8e6a_fc16c71af79b.slice/crio-6017ea2ff4c987098732567bee9e38d3437fc965be53066f0271e29aaeb337ae WatchSource:0}: Error finding container 6017ea2ff4c987098732567bee9e38d3437fc965be53066f0271e29aaeb337ae: Status 404 returned error can't find the container with id 6017ea2ff4c987098732567bee9e38d3437fc965be53066f0271e29aaeb337ae Jun 09 11:57:38.771696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.771665 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:38.814628 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.814602 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmljm\" (UniqueName: \"kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm\") pod \"authorino-58cd955675-zgjs5\" (UID: \"a9cbacd0-fec9-4b62-8957-fd6b14041849\") " pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:38.858812 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.858723 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:57:38.915900 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.915864 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmljm\" (UniqueName: \"kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm\") pod \"authorino-58cd955675-zgjs5\" (UID: \"a9cbacd0-fec9-4b62-8957-fd6b14041849\") " pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:38.924814 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:38.924788 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmljm\" (UniqueName: \"kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm\") pod \"authorino-58cd955675-zgjs5\" (UID: \"a9cbacd0-fec9-4b62-8957-fd6b14041849\") " pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:39.046424 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:39.046372 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:39.184371 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:39.184335 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:39.186869 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:57:39.186841 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9cbacd0_fec9_4b62_8957_fd6b14041849.slice/crio-598a4ba83724df42b5ab4d751c32141eac1e33f7c306998e021d55da7a36fa9c WatchSource:0}: Error finding container 598a4ba83724df42b5ab4d751c32141eac1e33f7c306998e021d55da7a36fa9c: Status 404 returned error can't find the container with id 598a4ba83724df42b5ab4d751c32141eac1e33f7c306998e021d55da7a36fa9c Jun 09 11:57:39.469593 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:39.469502 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" event={"ID":"1f57de66-7bdb-4941-8e6a-fc16c71af79b","Type":"ContainerStarted","Data":"6017ea2ff4c987098732567bee9e38d3437fc965be53066f0271e29aaeb337ae"} Jun 09 11:57:39.471572 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:39.471513 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zgjs5" event={"ID":"a9cbacd0-fec9-4b62-8957-fd6b14041849","Type":"ContainerStarted","Data":"598a4ba83724df42b5ab4d751c32141eac1e33f7c306998e021d55da7a36fa9c"} Jun 09 11:57:43.234795 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.234755 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:43.498060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.497953 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" event={"ID":"1f57de66-7bdb-4941-8e6a-fc16c71af79b","Type":"ContainerStarted","Data":"81018e9b8aecabbf95d50c8d45012a33dbc0f4f6fa734866fc3c47a65819382b"} Jun 09 11:57:43.498060 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.498048 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:43.499370 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.499346 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zgjs5" event={"ID":"a9cbacd0-fec9-4b62-8957-fd6b14041849","Type":"ContainerStarted","Data":"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50"} Jun 09 11:57:43.526526 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.526480 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" podStartSLOduration=1.168383603 podStartE2EDuration="5.526461497s" totalImagesPullingTime="4.358077894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:57:43.524729953 +0000 UTC m=+742.605235902" watchObservedRunningTime="2026-06-09 11:57:43.526461497 +0000 UTC m=+742.606967423" Jun 09 11:57:43.548478 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:43.548426 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-zgjs5" podStartSLOduration=1.6180007010000002 podStartE2EDuration="5.548396266s" totalImagesPullingTime="3.930395565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:57:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:57:43.546514704 +0000 UTC m=+742.627020630" watchObservedRunningTime="2026-06-09 11:57:43.548396266 +0000 UTC m=+742.628902194" Jun 09 11:57:44.504546 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:44.504506 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-zgjs5" podUID="a9cbacd0-fec9-4b62-8957-fd6b14041849" containerName="authorino" containerID="cri-o://0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50" gracePeriod=30 Jun 09 11:57:44.748475 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:44.748451 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:44.874587 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:44.874558 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vmljm\" (UniqueName: \"kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm\") pod \"a9cbacd0-fec9-4b62-8957-fd6b14041849\" (UID: \"a9cbacd0-fec9-4b62-8957-fd6b14041849\") " Jun 09 11:57:44.876573 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:44.876549 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm" (OuterVolumeSpecName: "kube-api-access-vmljm") pod "a9cbacd0-fec9-4b62-8957-fd6b14041849" (UID: "a9cbacd0-fec9-4b62-8957-fd6b14041849"). InnerVolumeSpecName "kube-api-access-vmljm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 11:57:44.975623 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:44.975590 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vmljm\" (UniqueName: \"kubernetes.io/projected/a9cbacd0-fec9-4b62-8957-fd6b14041849-kube-api-access-vmljm\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 11:57:45.510652 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.510613 2578 generic.go:356] "Generic (PLEG): container finished" podID="a9cbacd0-fec9-4b62-8957-fd6b14041849" containerID="0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50" exitCode=0 Jun 09 11:57:45.510652 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.510656 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-zgjs5" Jun 09 11:57:45.511166 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.510661 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zgjs5" event={"ID":"a9cbacd0-fec9-4b62-8957-fd6b14041849","Type":"ContainerDied","Data":"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50"} Jun 09 11:57:45.511166 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.510699 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-zgjs5" event={"ID":"a9cbacd0-fec9-4b62-8957-fd6b14041849","Type":"ContainerDied","Data":"598a4ba83724df42b5ab4d751c32141eac1e33f7c306998e021d55da7a36fa9c"} Jun 09 11:57:45.511166 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.510720 2578 scope.go:117] "RemoveContainer" containerID="0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50" Jun 09 11:57:45.519886 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.519868 2578 scope.go:117] "RemoveContainer" containerID="0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50" Jun 09 11:57:45.520208 ip-10-0-128-244 kubenswrapper[2578]: E0609 11:57:45.520188 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50\": container with ID starting with 0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50 not found: ID does not exist" containerID="0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50" Jun 09 11:57:45.520270 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.520222 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50"} err="failed to get container status \"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50\": rpc error: code = NotFound desc = could not find container \"0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50\": container with ID starting with 0d7020e149182d575bcbc00642b1d09e96b286c49bad43d6af2378947a180f50 not found: ID does not exist" Jun 09 11:57:45.527911 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.527882 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:45.530308 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:45.530282 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-zgjs5"] Jun 09 11:57:47.344242 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:47.344209 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a9cbacd0-fec9-4b62-8957-fd6b14041849" path="/var/lib/kubelet/pods/a9cbacd0-fec9-4b62-8957-fd6b14041849/volumes" Jun 09 11:57:54.506052 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:54.506019 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-hs7hj" Jun 09 11:57:59.055983 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:57:59.055954 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:58:08.884981 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:58:08.884942 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:58:08.981444 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:58:08.981390 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:58:09.137716 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:58:09.137628 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:58:32.627926 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:58:32.627888 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:58:32.727673 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:58:32.727638 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:02.182086 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:02.182034 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:02.305183 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:02.305148 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:07.167631 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:07.167596 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:07.288138 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:07.288098 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:07.374629 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:07.374594 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:07.735766 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:07.735724 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:10.777717 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:10.777685 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:10.884432 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:10.884358 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:41.765924 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:41.765890 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:42.038137 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.038042 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:42.201537 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.201501 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:42.297721 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.297637 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:42.298696 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.298671 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6d5kt"] Jun 09 11:59:42.299086 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.299070 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a9cbacd0-fec9-4b62-8957-fd6b14041849" containerName="authorino" Jun 09 11:59:42.299168 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.299090 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="a9cbacd0-fec9-4b62-8957-fd6b14041849" containerName="authorino" Jun 09 11:59:42.299225 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.299206 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="a9cbacd0-fec9-4b62-8957-fd6b14041849" containerName="authorino" Jun 09 11:59:42.302029 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.302012 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:42.304422 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.304390 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jun 09 11:59:42.304534 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.304460 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gvnx6\"" Jun 09 11:59:42.312848 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.312824 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6d5kt"] Jun 09 11:59:42.337274 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.337235 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jml6j\" (UniqueName: \"kubernetes.io/projected/b92d3679-3929-4157-b1aa-972086ae531a-kube-api-access-jml6j\") pod \"payload-pre-processing-67d7689b65-6d5kt\" (UID: \"b92d3679-3929-4157-b1aa-972086ae531a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:42.437924 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.437886 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jml6j\" (UniqueName: \"kubernetes.io/projected/b92d3679-3929-4157-b1aa-972086ae531a-kube-api-access-jml6j\") pod \"payload-pre-processing-67d7689b65-6d5kt\" (UID: \"b92d3679-3929-4157-b1aa-972086ae531a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:42.448037 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.448005 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jml6j\" (UniqueName: \"kubernetes.io/projected/b92d3679-3929-4157-b1aa-972086ae531a-kube-api-access-jml6j\") pod \"payload-pre-processing-67d7689b65-6d5kt\" (UID: \"b92d3679-3929-4157-b1aa-972086ae531a\") " pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:42.455463 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.455429 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 11:59:42.612582 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.612539 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:42.750813 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:42.750789 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-67d7689b65-6d5kt"] Jun 09 11:59:42.753224 ip-10-0-128-244 kubenswrapper[2578]: W0609 11:59:42.753196 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb92d3679_3929_4157_b1aa_972086ae531a.slice/crio-65d814442a9f0db59421dfb6512eb8d20d9fa247361b28347ec78b509bf3a28a WatchSource:0}: Error finding container 65d814442a9f0db59421dfb6512eb8d20d9fa247361b28347ec78b509bf3a28a: Status 404 returned error can't find the container with id 65d814442a9f0db59421dfb6512eb8d20d9fa247361b28347ec78b509bf3a28a Jun 09 11:59:43.060383 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:43.060353 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" event={"ID":"b92d3679-3929-4157-b1aa-972086ae531a","Type":"ContainerStarted","Data":"65d814442a9f0db59421dfb6512eb8d20d9fa247361b28347ec78b509bf3a28a"} Jun 09 11:59:45.072617 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:45.072575 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" event={"ID":"b92d3679-3929-4157-b1aa-972086ae531a","Type":"ContainerStarted","Data":"234948eea0ac8044fa66d32068d34401d2583dc61a9d94f021a9591155f430ba"} Jun 09 11:59:45.073059 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:45.072708 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:45.106941 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:45.106896 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" podStartSLOduration=0.938602553 podStartE2EDuration="3.106879657s" totalImagesPullingTime="2.168277104s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 11:59:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 11:59:45.10520249 +0000 UTC m=+864.185708434" watchObservedRunningTime="2026-06-09 11:59:45.106879657 +0000 UTC m=+864.187385583" Jun 09 11:59:55.414101 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:55.414067 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 11:59:56.079263 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:56.079230 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-67d7689b65-6d5kt" Jun 09 11:59:56.629284 ip-10-0-128-244 kubenswrapper[2578]: I0609 11:59:56.629251 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:00.140999 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.140959 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29683440-czhns"] Jun 09 12:00:00.144484 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.144462 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:00.146813 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.146793 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-6wsx4\"" Jun 09 12:00:00.150926 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.150892 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683440-czhns"] Jun 09 12:00:00.200416 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.200373 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dqzpp\" (UniqueName: \"kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp\") pod \"maas-api-key-cleanup-29683440-czhns\" (UID: \"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543\") " pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:00.301523 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.301489 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dqzpp\" (UniqueName: \"kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp\") pod \"maas-api-key-cleanup-29683440-czhns\" (UID: \"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543\") " pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:00.312616 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.312586 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dqzpp\" (UniqueName: \"kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp\") pod \"maas-api-key-cleanup-29683440-czhns\" (UID: \"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543\") " pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:00.456759 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.456671 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:00.588441 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:00.588392 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29683440-czhns"] Jun 09 12:00:00.590431 ip-10-0-128-244 kubenswrapper[2578]: W0609 12:00:00.590377 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc66d8504_19a5_4a2a_ad5a_fdb03bc5f543.slice/crio-47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8 WatchSource:0}: Error finding container 47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8: Status 404 returned error can't find the container with id 47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8 Jun 09 12:00:01.154277 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:01.154241 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" event={"ID":"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543","Type":"ContainerStarted","Data":"47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8"} Jun 09 12:00:11.202747 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:11.202712 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" event={"ID":"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543","Type":"ContainerStarted","Data":"e4fbcfa93408ae53cb3afda00b05a28654582a82e935f1ad4891eb0928b0daa1"} Jun 09 12:00:11.220064 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:11.220012 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" podStartSLOduration=1.502133819 podStartE2EDuration="11.219997126s" totalImagesPullingTime="9.717863307s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:11.218264443 +0000 UTC m=+890.298770370" watchObservedRunningTime="2026-06-09 12:00:11.219997126 +0000 UTC m=+890.300503052" Jun 09 12:00:12.208825 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:12.208786 2578 generic.go:356] "Generic (PLEG): container finished" podID="c66d8504-19a5-4a2a-ad5a-fdb03bc5f543" containerID="e4fbcfa93408ae53cb3afda00b05a28654582a82e935f1ad4891eb0928b0daa1" exitCode=0 Jun 09 12:00:12.209237 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:12.208840 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" event={"ID":"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543","Type":"ContainerDied","Data":"e4fbcfa93408ae53cb3afda00b05a28654582a82e935f1ad4891eb0928b0daa1"} Jun 09 12:00:13.347039 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:13.347012 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:13.521364 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:13.521257 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dqzpp\" (UniqueName: \"kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp\") pod \"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543\" (UID: \"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543\") " Jun 09 12:00:13.523503 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:13.523476 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp" (OuterVolumeSpecName: "kube-api-access-dqzpp") pod "c66d8504-19a5-4a2a-ad5a-fdb03bc5f543" (UID: "c66d8504-19a5-4a2a-ad5a-fdb03bc5f543"). InnerVolumeSpecName "kube-api-access-dqzpp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:00:13.622365 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:13.622328 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dqzpp\" (UniqueName: \"kubernetes.io/projected/c66d8504-19a5-4a2a-ad5a-fdb03bc5f543-kube-api-access-dqzpp\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 12:00:14.219483 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:14.219453 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" event={"ID":"c66d8504-19a5-4a2a-ad5a-fdb03bc5f543","Type":"ContainerDied","Data":"47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8"} Jun 09 12:00:14.219659 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:14.219506 2578 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47cf551c4351bad329ad25727ae80daa79360839c12ece592d9a36517277f7c8" Jun 09 12:00:14.219659 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:14.219451 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29683440-czhns" Jun 09 12:00:21.368177 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:21.368149 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:00:21.369861 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:21.369839 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:00:21.375895 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:21.375873 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:00:21.377544 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:21.377526 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:00:24.781797 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:24.781759 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:29.135351 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.135314 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:00:29.135775 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.135701 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c66d8504-19a5-4a2a-ad5a-fdb03bc5f543" containerName="cleanup" Jun 09 12:00:29.135775 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.135716 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="c66d8504-19a5-4a2a-ad5a-fdb03bc5f543" containerName="cleanup" Jun 09 12:00:29.135870 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.135800 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="c66d8504-19a5-4a2a-ad5a-fdb03bc5f543" containerName="cleanup" Jun 09 12:00:29.140238 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.140217 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.142909 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.142888 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 09 12:00:29.143854 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.143830 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 09 12:00:29.143966 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.143912 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-j8hg2\"" Jun 09 12:00:29.149608 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.149582 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:00:29.172237 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.172197 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.172371 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.172275 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2hm4\" (UniqueName: \"kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.172371 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.172299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.272877 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.272828 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.273041 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.272915 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2hm4\" (UniqueName: \"kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.273041 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.272939 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.273589 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.273561 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.275330 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.275308 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.280701 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.280678 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2hm4\" (UniqueName: \"kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4\") pod \"authorino-85646b98d6-7qqp4\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.449944 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.449863 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:00:29.590896 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:29.590838 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:00:29.593097 ip-10-0-128-244 kubenswrapper[2578]: W0609 12:00:29.593069 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod87ad92c2_bb7f_41e3_9919_771782c67ac7.slice/crio-4e1febef20057d385dcd91ad0f5d201fc123fa893b4d640384c400d9a4608264 WatchSource:0}: Error finding container 4e1febef20057d385dcd91ad0f5d201fc123fa893b4d640384c400d9a4608264: Status 404 returned error can't find the container with id 4e1febef20057d385dcd91ad0f5d201fc123fa893b4d640384c400d9a4608264 Jun 09 12:00:30.297637 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:30.297605 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85646b98d6-7qqp4" event={"ID":"87ad92c2-bb7f-41e3-9919-771782c67ac7","Type":"ContainerStarted","Data":"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3"} Jun 09 12:00:30.297637 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:30.297647 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85646b98d6-7qqp4" event={"ID":"87ad92c2-bb7f-41e3-9919-771782c67ac7","Type":"ContainerStarted","Data":"4e1febef20057d385dcd91ad0f5d201fc123fa893b4d640384c400d9a4608264"} Jun 09 12:00:30.316093 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:30.316034 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-85646b98d6-7qqp4" podStartSLOduration=0.835355379 podStartE2EDuration="1.316012083s" totalImagesPullingTime="480.656704ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:00:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:00:30.313210792 +0000 UTC m=+909.393716721" watchObservedRunningTime="2026-06-09 12:00:30.316012083 +0000 UTC m=+909.396518012" Jun 09 12:00:30.775488 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:30.775451 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:30.875166 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:30.875121 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:42.459367 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:42.459331 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:42.896105 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:42.896070 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:00:58.821164 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:58.821119 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:00:59.085350 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:00:59.085252 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:01:02.470755 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:02.470719 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:01:02.709798 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:02.709763 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:01:06.769298 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:06.769258 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:01:07.308935 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:07.308895 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:01:35.274944 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:35.274907 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:01:36.094734 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:36.094701 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:01:43.340596 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:43.340485 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:01:44.204904 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:01:44.204866 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:02:11.701957 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:11.701918 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:11.801085 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:11.801035 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:13.283860 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:13.283824 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:13.344505 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:13.344462 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:41.736207 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:41.736169 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:56.096924 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:56.096877 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:02:56.158305 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:02:56.158239 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:03:00.838961 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.838929 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6b4d9cc8c5-5b5rd"] Jun 09 12:03:00.842235 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.842219 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:00.852090 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.852065 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b4d9cc8c5-5b5rd"] Jun 09 12:03:00.980336 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.980299 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e69af-a059-4050-9076-29ad18e1c6ba-oidc-ca\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:00.980540 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.980350 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsnq\" (UniqueName: \"kubernetes.io/projected/ae5e69af-a059-4050-9076-29ad18e1c6ba-kube-api-access-jgsnq\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:00.980540 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:00.980456 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae5e69af-a059-4050-9076-29ad18e1c6ba-tls-cert\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.081001 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.080960 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae5e69af-a059-4050-9076-29ad18e1c6ba-tls-cert\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.081218 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.081072 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e69af-a059-4050-9076-29ad18e1c6ba-oidc-ca\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.081218 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.081117 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsnq\" (UniqueName: \"kubernetes.io/projected/ae5e69af-a059-4050-9076-29ad18e1c6ba-kube-api-access-jgsnq\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.081739 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.081717 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/ae5e69af-a059-4050-9076-29ad18e1c6ba-oidc-ca\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.083345 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.083328 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/ae5e69af-a059-4050-9076-29ad18e1c6ba-tls-cert\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.089759 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.089708 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsnq\" (UniqueName: \"kubernetes.io/projected/ae5e69af-a059-4050-9076-29ad18e1c6ba-kube-api-access-jgsnq\") pod \"authorino-6b4d9cc8c5-5b5rd\" (UID: \"ae5e69af-a059-4050-9076-29ad18e1c6ba\") " pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.152539 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.152509 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" Jun 09 12:03:01.296798 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.296774 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6b4d9cc8c5-5b5rd"] Jun 09 12:03:01.299014 ip-10-0-128-244 kubenswrapper[2578]: W0609 12:03:01.298987 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podae5e69af_a059_4050_9076_29ad18e1c6ba.slice/crio-8ca03cdda528b83de47180a95dd973ba05f2d3bbdae04123dc3c70519d8ed581 WatchSource:0}: Error finding container 8ca03cdda528b83de47180a95dd973ba05f2d3bbdae04123dc3c70519d8ed581: Status 404 returned error can't find the container with id 8ca03cdda528b83de47180a95dd973ba05f2d3bbdae04123dc3c70519d8ed581 Jun 09 12:03:01.300665 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.300648 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:03:01.342452 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.342338 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:03:01.437744 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:01.437707 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:03:02.038605 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.038469 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" event={"ID":"ae5e69af-a059-4050-9076-29ad18e1c6ba","Type":"ContainerStarted","Data":"8fb4546eaaaded9b358dc8e15d74fe717422c37375a3dfc71b170c27d3fd8f4e"} Jun 09 12:03:02.038605 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.038526 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" event={"ID":"ae5e69af-a059-4050-9076-29ad18e1c6ba","Type":"ContainerStarted","Data":"8ca03cdda528b83de47180a95dd973ba05f2d3bbdae04123dc3c70519d8ed581"} Jun 09 12:03:02.060832 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.060757 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6b4d9cc8c5-5b5rd" podStartSLOduration=1.58269916 podStartE2EDuration="2.060738331s" totalImagesPullingTime="478.039171ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:03:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:03:02.059961993 +0000 UTC m=+1061.140467925" watchObservedRunningTime="2026-06-09 12:03:02.060738331 +0000 UTC m=+1061.141244260" Jun 09 12:03:02.096641 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.096601 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:03:02.098701 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.098669 2578 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-85646b98d6-7qqp4" podUID="87ad92c2-bb7f-41e3-9919-771782c67ac7" containerName="authorino" containerID="cri-o://cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3" gracePeriod=30 Jun 09 12:03:02.355771 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.355742 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:03:02.412155 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.412114 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:03:02.502739 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.502709 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert\") pod \"87ad92c2-bb7f-41e3-9919-771782c67ac7\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " Jun 09 12:03:02.502739 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.502745 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca\") pod \"87ad92c2-bb7f-41e3-9919-771782c67ac7\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " Jun 09 12:03:02.502989 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.502819 2578 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2hm4\" (UniqueName: \"kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4\") pod \"87ad92c2-bb7f-41e3-9919-771782c67ac7\" (UID: \"87ad92c2-bb7f-41e3-9919-771782c67ac7\") " Jun 09 12:03:02.504855 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.504819 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4" (OuterVolumeSpecName: "kube-api-access-m2hm4") pod "87ad92c2-bb7f-41e3-9919-771782c67ac7" (UID: "87ad92c2-bb7f-41e3-9919-771782c67ac7"). InnerVolumeSpecName "kube-api-access-m2hm4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 09 12:03:02.507820 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.507796 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "87ad92c2-bb7f-41e3-9919-771782c67ac7" (UID: "87ad92c2-bb7f-41e3-9919-771782c67ac7"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 09 12:03:02.511695 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.511666 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:03:02.513159 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.513137 2578 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "87ad92c2-bb7f-41e3-9919-771782c67ac7" (UID: "87ad92c2-bb7f-41e3-9919-771782c67ac7"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 09 12:03:02.603914 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.603812 2578 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2hm4\" (UniqueName: \"kubernetes.io/projected/87ad92c2-bb7f-41e3-9919-771782c67ac7-kube-api-access-m2hm4\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 12:03:02.603914 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.603855 2578 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/87ad92c2-bb7f-41e3-9919-771782c67ac7-tls-cert\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 12:03:02.603914 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:02.603865 2578 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/87ad92c2-bb7f-41e3-9919-771782c67ac7-oidc-ca\") on node \"ip-10-0-128-244.ec2.internal\" DevicePath \"\"" Jun 09 12:03:03.044546 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.044452 2578 generic.go:356] "Generic (PLEG): container finished" podID="87ad92c2-bb7f-41e3-9919-771782c67ac7" containerID="cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3" exitCode=0 Jun 09 12:03:03.044546 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.044499 2578 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-85646b98d6-7qqp4" Jun 09 12:03:03.044546 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.044535 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85646b98d6-7qqp4" event={"ID":"87ad92c2-bb7f-41e3-9919-771782c67ac7","Type":"ContainerDied","Data":"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3"} Jun 09 12:03:03.045137 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.044579 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-85646b98d6-7qqp4" event={"ID":"87ad92c2-bb7f-41e3-9919-771782c67ac7","Type":"ContainerDied","Data":"4e1febef20057d385dcd91ad0f5d201fc123fa893b4d640384c400d9a4608264"} Jun 09 12:03:03.045137 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.044600 2578 scope.go:117] "RemoveContainer" containerID="cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3" Jun 09 12:03:03.053602 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.053584 2578 scope.go:117] "RemoveContainer" containerID="cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3" Jun 09 12:03:03.053922 ip-10-0-128-244 kubenswrapper[2578]: E0609 12:03:03.053877 2578 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3\": container with ID starting with cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3 not found: ID does not exist" containerID="cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3" Jun 09 12:03:03.053981 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.053930 2578 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3"} err="failed to get container status \"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3\": rpc error: code = NotFound desc = could not find container \"cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3\": container with ID starting with cf15da0566b785323c4e5a402988cd9e3fc9b77f00bfe74535a271db633e1ea3 not found: ID does not exist" Jun 09 12:03:03.065720 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.065686 2578 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:03:03.069332 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.069306 2578 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-85646b98d6-7qqp4"] Jun 09 12:03:03.344607 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:03.344573 2578 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87ad92c2-bb7f-41e3-9919-771782c67ac7" path="/var/lib/kubelet/pods/87ad92c2-bb7f-41e3-9919-771782c67ac7/volumes" Jun 09 12:03:31.412275 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:31.412237 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:03:35.593786 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:35.593747 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:03:42.695111 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:42.695076 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:03:52.319715 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:03:52.319678 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:04:02.352556 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:02.352521 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:04:11.607496 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:11.607461 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:04:21.197879 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:21.197844 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:04:31.702529 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:31.702491 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:04:38.963826 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:38.963747 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:04:40.471646 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:04:40.471603 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:03.703893 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:03.703849 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:05:07.072494 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:07.072457 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:05:13.974749 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:13.974711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:20.429872 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:20.429834 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:20.650928 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:20.650895 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:21.401234 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:21.401195 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:05:21.403822 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:21.403799 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:05:21.408749 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:21.408729 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:05:21.411215 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:21.411200 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:05:28.951787 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:28.951754 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:35.556962 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:35.556925 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:35.639261 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:35.639221 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:05:44.414811 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:05:44.414778 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:06:00.392451 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:00.392416 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:06:07.692297 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:07.692216 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:07.790034 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:07.790005 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:31.663179 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:31.663138 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:35.664587 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:35.664555 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:35.774602 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:35.774560 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:38.517626 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:38.517570 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:38.626795 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:38.626755 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:38.793639 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:38.793508 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:38.941050 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:38.941000 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:39.057194 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:39.057165 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:40.319028 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:40.318993 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:06:55.490949 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:55.490914 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:55.653802 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:55.653768 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:55.866688 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:55.866652 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:06:57.123359 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:06:57.123325 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:07:02.749015 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:02.748975 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:02.870115 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:02.870065 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:10.970150 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:10.970113 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:11.099128 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:11.099092 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:11.232492 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:11.232385 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:12.219434 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:12.219381 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:07:27.687189 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:27.687156 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:27.705367 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:27.705337 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:07:27.808429 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:27.808365 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:27.907743 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:27.907711 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:30.797490 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:30.797458 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:07:33.672484 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:33.672452 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:33.736114 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:33.736080 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:56.319602 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:56.319512 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:56.419966 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:56.419913 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:07:56.549971 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:07:56.549939 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:02.324387 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:02.324356 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:02.386764 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:02.386717 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:02.464170 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:02.464133 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:02.564352 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:02.564322 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:02.678218 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:02.678128 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:08.680090 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:08.680038 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:08.756034 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:08.756002 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:08:34.989351 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:34.989313 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:08:43.508175 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:43.508139 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:08:59.800430 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:08:59.800365 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:09:08.595611 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:09:08.595575 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:09:16.793485 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:09:16.793449 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:09:37.209194 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:09:37.209158 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:09:46.705310 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:09:46.705272 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:09:55.099672 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:09:55.099635 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:10:21.431198 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:21.431168 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:10:21.434633 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:21.434610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:10:21.439337 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:21.439319 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:10:21.442601 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:21.442582 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:10:26.796157 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:26.796121 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:10:35.694047 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:35.694003 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:10:43.698027 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:43.697940 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:10:52.186268 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:10:52.186230 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:00.507370 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:00.507251 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:09.097481 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:09.097443 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:12.491313 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:12.491278 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:17.688295 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:17.688256 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:25.986715 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:25.986677 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-hs7hj"] Jun 09 12:11:34.062152 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:34.062101 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9cc8c5-5b5rd_ae5e69af-a059-4050-9076-29ad18e1c6ba/authorino/0.log" Jun 09 12:11:39.188917 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:39.188882 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683440-czhns_c66d8504-19a5-4a2a-ad5a-fdb03bc5f543/cleanup/0.log" Jun 09 12:11:39.770595 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:39.770566 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5778ccf7-t9jvt_c450ab80-3e80-45c2-8097-92f2e7ced800/copy-manifests/0.log" Jun 09 12:11:39.782757 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:39.782724 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5778ccf7-t9jvt_c450ab80-3e80-45c2-8097-92f2e7ced800/manager/0.log" Jun 09 12:11:41.274968 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:41.274939 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9cc8c5-5b5rd_ae5e69af-a059-4050-9076-29ad18e1c6ba/authorino/0.log" Jun 09 12:11:41.955858 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:41.955826 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hs7hj_1f57de66-7bdb-4941-8e6a-fc16c71af79b/limitador/0.log" Jun 09 12:11:42.066351 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:42.066322 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nmw7d_ba8a0227-4fba-4419-b60f-3c7eb0981a87/manager/0.log" Jun 09 12:11:42.635902 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:42.635875 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cb988c7-jxvv5_b6004faa-a8fd-4651-afe1-7a6c3af8aab8/kube-auth-proxy/0.log" Jun 09 12:11:42.982644 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:42.982535 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6d5kt_b92d3679-3929-4157-b1aa-972086ae531a/payload-pre-processing/0.log" Jun 09 12:11:47.950572 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.950536 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j58gl/must-gather-jqpjl"] Jun 09 12:11:47.950963 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.950892 2578 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87ad92c2-bb7f-41e3-9919-771782c67ac7" containerName="authorino" Jun 09 12:11:47.950963 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.950903 2578 state_mem.go:107] "Deleted CPUSet assignment" podUID="87ad92c2-bb7f-41e3-9919-771782c67ac7" containerName="authorino" Jun 09 12:11:47.951042 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.950975 2578 memory_manager.go:368] "RemoveStaleState removing state" podUID="87ad92c2-bb7f-41e3-9919-771782c67ac7" containerName="authorino" Jun 09 12:11:47.954331 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.954311 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:47.957186 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.957163 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j58gl\"/\"openshift-service-ca.crt\"" Jun 09 12:11:47.957372 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.957360 2578 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-j58gl\"/\"default-dockercfg-nkdhk\"" Jun 09 12:11:47.958189 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.958159 2578 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-j58gl\"/\"kube-root-ca.crt\"" Jun 09 12:11:47.963895 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.963870 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j58gl/must-gather-jqpjl"] Jun 09 12:11:47.983847 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.983808 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a146cdd0-92c8-425b-9370-99d6c8f65258-must-gather-output\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:47.983983 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:47.983858 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-grqb7\" (UniqueName: \"kubernetes.io/projected/a146cdd0-92c8-425b-9370-99d6c8f65258-kube-api-access-grqb7\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.085254 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.085220 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a146cdd0-92c8-425b-9370-99d6c8f65258-must-gather-output\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.085254 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.085263 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-grqb7\" (UniqueName: \"kubernetes.io/projected/a146cdd0-92c8-425b-9370-99d6c8f65258-kube-api-access-grqb7\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.085639 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.085618 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a146cdd0-92c8-425b-9370-99d6c8f65258-must-gather-output\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.093776 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.093749 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-grqb7\" (UniqueName: \"kubernetes.io/projected/a146cdd0-92c8-425b-9370-99d6c8f65258-kube-api-access-grqb7\") pod \"must-gather-jqpjl\" (UID: \"a146cdd0-92c8-425b-9370-99d6c8f65258\") " pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.265468 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.265366 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j58gl/must-gather-jqpjl" Jun 09 12:11:48.399696 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.399644 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j58gl/must-gather-jqpjl"] Jun 09 12:11:48.402700 ip-10-0-128-244 kubenswrapper[2578]: W0609 12:11:48.402670 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda146cdd0_92c8_425b_9370_99d6c8f65258.slice/crio-c8aacb03754b96ea6dcc6c8762d2f9867bbc4700aa4b0a94547aaa485befd378 WatchSource:0}: Error finding container c8aacb03754b96ea6dcc6c8762d2f9867bbc4700aa4b0a94547aaa485befd378: Status 404 returned error can't find the container with id c8aacb03754b96ea6dcc6c8762d2f9867bbc4700aa4b0a94547aaa485befd378 Jun 09 12:11:48.405045 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.405027 2578 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 09 12:11:48.565141 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.565109 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j58gl/must-gather-jqpjl" event={"ID":"a146cdd0-92c8-425b-9370-99d6c8f65258","Type":"ContainerStarted","Data":"c8aacb03754b96ea6dcc6c8762d2f9867bbc4700aa4b0a94547aaa485befd378"} Jun 09 12:11:48.816378 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:48.816300 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:11:49.574993 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:49.574955 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j58gl/must-gather-jqpjl" event={"ID":"a146cdd0-92c8-425b-9370-99d6c8f65258","Type":"ContainerStarted","Data":"fb63935c04bcb52eb14b2570fe8c2dcb14be882cb36fc6734f713633b4e4940a"} Jun 09 12:11:49.575476 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:49.575006 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j58gl/must-gather-jqpjl" event={"ID":"a146cdd0-92c8-425b-9370-99d6c8f65258","Type":"ContainerStarted","Data":"b8fd2a133f71ff6fb1689ac3a324dafc4657113e38c7a4b242e339f15b6c4815"} Jun 09 12:11:49.592677 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:49.592612 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j58gl/must-gather-jqpjl" podStartSLOduration=1.848617717 podStartE2EDuration="2.592589591s" totalImagesPullingTime="743.971874ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-09 12:11:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:11:49.591279311 +0000 UTC m=+1588.671785239" watchObservedRunningTime="2026-06-09 12:11:49.592589591 +0000 UTC m=+1588.673095519" Jun 09 12:11:49.797676 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:49.797610 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:11:50.873913 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:50.873884 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8xxbv_0973fe4e-b071-4133-856b-f62e31484959/global-pull-secret-syncer/0.log" Jun 09 12:11:50.961538 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:50.961507 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" Jun 09 12:11:51.043187 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:51.043157 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-244.ec2.internal_49eb15443a8878ff81426663865baab6/haproxy/0.log" Jun 09 12:11:56.110231 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:56.109925 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6b4d9cc8c5-5b5rd_ae5e69af-a059-4050-9076-29ad18e1c6ba/authorino/0.log" Jun 09 12:11:56.358597 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:56.358509 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-hs7hj_1f57de66-7bdb-4941-8e6a-fc16c71af79b/limitador/0.log" Jun 09 12:11:56.403011 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:56.402917 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nmw7d_ba8a0227-4fba-4419-b60f-3c7eb0981a87/manager/0.log" Jun 09 12:11:57.924841 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:57.924764 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/alertmanager/0.log" Jun 09 12:11:57.949942 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:57.949912 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/config-reloader/0.log" Jun 09 12:11:57.974690 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:57.974658 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/kube-rbac-proxy-web/0.log" Jun 09 12:11:57.998095 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:57.998064 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/kube-rbac-proxy/0.log" Jun 09 12:11:58.024191 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.024145 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/kube-rbac-proxy-metric/0.log" Jun 09 12:11:58.051486 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.051455 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/prom-label-proxy/0.log" Jun 09 12:11:58.079745 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.079716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_031eba6c-e786-4d54-b9b5-c2f050c64ddc/init-config-reloader/0.log" Jun 09 12:11:58.095618 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.095579 2578 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-72pzm_32d38238-873e-4e94-b5a0-cd2ca752fbde/konnectivity-agent/0.log" limit=1024 Jun 09 12:11:58.312634 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.312603 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l6bf_e59d3bfc-9fb4-4430-9546-8d56a50fd05a/node-exporter/0.log" Jun 09 12:11:58.333633 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.333601 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l6bf_e59d3bfc-9fb4-4430-9546-8d56a50fd05a/kube-rbac-proxy/0.log" Jun 09 12:11:58.357490 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.357464 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-6l6bf_e59d3bfc-9fb4-4430-9546-8d56a50fd05a/init-textfile/0.log" Jun 09 12:11:58.536017 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.535930 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xfnbk_f5fb288d-7ac2-450d-9098-663e4316f866/kube-rbac-proxy-main/0.log" Jun 09 12:11:58.558714 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.558681 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xfnbk_f5fb288d-7ac2-450d-9098-663e4316f866/kube-rbac-proxy-self/0.log" Jun 09 12:11:58.582967 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.582931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-65f78d5c66-xfnbk_f5fb288d-7ac2-450d-9098-663e4316f866/openshift-state-metrics/0.log" Jun 09 12:11:58.628746 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.628708 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/prometheus/0.log" Jun 09 12:11:58.650748 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.650715 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/config-reloader/0.log" Jun 09 12:11:58.675609 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.675580 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/thanos-sidecar/0.log" Jun 09 12:11:58.740914 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.735366 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/kube-rbac-proxy-web/0.log" Jun 09 12:11:58.764422 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.764257 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/kube-rbac-proxy/0.log" Jun 09 12:11:58.807364 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.805480 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/kube-rbac-proxy-thanos/0.log" Jun 09 12:11:58.828182 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.828148 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_4b69e196-21c2-418d-96c0-03b785e5f8cb/init-config-reloader/0.log" Jun 09 12:11:58.865553 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.865253 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nk4k6_e2d26654-f2e2-409b-b940-c945ba43fd7c/prometheus-operator/0.log" Jun 09 12:11:58.898426 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.897553 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-7f7d445d84-nk4k6_e2d26654-f2e2-409b-b940-c945ba43fd7c/kube-rbac-proxy/0.log" Jun 09 12:11:58.978848 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:58.978766 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b799b9f99-7pqdg_2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f/telemeter-client/0.log" Jun 09 12:11:59.007951 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:59.007920 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b799b9f99-7pqdg_2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f/reload/0.log" Jun 09 12:11:59.039119 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:11:59.039093 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-5b799b9f99-7pqdg_2f1f8998-2a1e-4e4f-b4d2-72ea80cf507f/kube-rbac-proxy/0.log" Jun 09 12:12:00.616686 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:00.616653 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-d5d5bb78b-5cxzn_4bef8fe7-f4ec-41cb-a5cf-098d1588fd4e/networking-console-plugin/0.log" Jun 09 12:12:01.294932 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:01.294906 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/1.log" Jun 09 12:12:01.300603 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:01.300578 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-668fdbf85c-j5dlr_61657ac6-eb2a-46f5-b10d-139d6a2abf92/console-operator/2.log" Jun 09 12:12:01.828867 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:01.828843 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-677d7dbd4d-n8zzk_85f6043f-b27d-489d-bdf4-72b4258a7a7a/console/0.log" Jun 09 12:12:01.859088 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:01.859053 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-6657875f97-mmjm5_c2ee02bb-dab2-4454-91f3-b4095af7a261/download-server/0.log" Jun 09 12:12:02.231531 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.231441 2578 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8"] Jun 09 12:12:02.239130 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.239094 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.249153 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.249119 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8"] Jun 09 12:12:02.343018 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.342979 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-sys\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.343215 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.343071 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-podres\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.343215 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.343106 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k25fv\" (UniqueName: \"kubernetes.io/projected/cfdaddaf-7844-4c87-a63a-b242103abec0-kube-api-access-k25fv\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.343215 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.343206 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-lib-modules\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.343391 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.343273 2578 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-proc\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444141 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444101 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-proc\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444334 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444257 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-sys\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444334 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444323 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-podres\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444491 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444350 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k25fv\" (UniqueName: \"kubernetes.io/projected/cfdaddaf-7844-4c87-a63a-b242103abec0-kube-api-access-k25fv\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444491 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444452 2578 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-lib-modules\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444657 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444639 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-lib-modules\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.444731 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.444716 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-proc\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.445230 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.445198 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-sys\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.445325 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.445307 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/cfdaddaf-7844-4c87-a63a-b242103abec0-podres\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.454215 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.454173 2578 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-k25fv\" (UniqueName: \"kubernetes.io/projected/cfdaddaf-7844-4c87-a63a-b242103abec0-kube-api-access-k25fv\") pod \"perf-node-gather-daemonset-2x9v8\" (UID: \"cfdaddaf-7844-4c87-a63a-b242103abec0\") " pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.553763 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.553725 2578 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:02.692259 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.692209 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78dd696465-jxqqd_e2b5f7ea-f254-4776-a3f3-75b48f49beb5/volume-data-source-validator/0.log" Jun 09 12:12:02.755619 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:02.755572 2578 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8"] Jun 09 12:12:02.764710 ip-10-0-128-244 kubenswrapper[2578]: W0609 12:12:02.763790 2578 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podcfdaddaf_7844_4c87_a63a_b242103abec0.slice/crio-5cbed4b9aec7a926235ec2193ebf5e1889c025255c999a656781b15b36aefb05 WatchSource:0}: Error finding container 5cbed4b9aec7a926235ec2193ebf5e1889c025255c999a656781b15b36aefb05: Status 404 returned error can't find the container with id 5cbed4b9aec7a926235ec2193ebf5e1889c025255c999a656781b15b36aefb05 Jun 09 12:12:03.685557 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.685521 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" event={"ID":"cfdaddaf-7844-4c87-a63a-b242103abec0","Type":"ContainerStarted","Data":"a4497770f8a90a17f6e23ed0f01dfbb5d1f7c5224a8dc28798ba9cba270f972c"} Jun 09 12:12:03.686256 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.686054 2578 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" event={"ID":"cfdaddaf-7844-4c87-a63a-b242103abec0","Type":"ContainerStarted","Data":"5cbed4b9aec7a926235ec2193ebf5e1889c025255c999a656781b15b36aefb05"} Jun 09 12:12:03.686256 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.686092 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:03.706438 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.703700 2578 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" podStartSLOduration=1.70367741 podStartE2EDuration="1.70367741s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-09 12:12:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-09 12:12:03.703062187 +0000 UTC m=+1602.783568113" watchObservedRunningTime="2026-06-09 12:12:03.70367741 +0000 UTC m=+1602.784183338" Jun 09 12:12:03.893812 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.893774 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5vf7n_5c52b33d-e979-4e97-90fd-197a7d8739ca/dns/0.log" Jun 09 12:12:03.916961 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:03.916931 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-5vf7n_5c52b33d-e979-4e97-90fd-197a7d8739ca/kube-rbac-proxy/0.log" Jun 09 12:12:04.036805 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:04.036731 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-9fv2r_72875ed7-85a7-46a1-989a-ad83cc45942e/dns-node-resolver/0.log" Jun 09 12:12:04.667108 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:04.667079 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-x2ml5_396faeea-35a2-4a9e-9df4-fadf363a70f3/node-ca/0.log" Jun 09 12:12:05.739312 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:05.739277 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cb988c7-jxvv5_b6004faa-a8fd-4651-afe1-7a6c3af8aab8/kube-auth-proxy/0.log" Jun 09 12:12:05.868751 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:05.868719 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6d5kt_b92d3679-3929-4157-b1aa-972086ae531a/payload-pre-processing/0.log" Jun 09 12:12:06.554164 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:06.554137 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-sj7nx_e996d8a9-62a8-46c4-a678-2f471fd81ca6/serve-healthcheck-canary/0.log" Jun 09 12:12:07.215470 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:07.215379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvmx2_02602828-ed14-48f4-9704-636c406b5cf1/kube-rbac-proxy/0.log" Jun 09 12:12:07.237090 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:07.237063 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvmx2_02602828-ed14-48f4-9704-636c406b5cf1/exporter/0.log" Jun 09 12:12:07.259298 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:07.259273 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zvmx2_02602828-ed14-48f4-9704-636c406b5cf1/extractor/0.log" Jun 09 12:12:09.632786 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:09.632697 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29683440-czhns_c66d8504-19a5-4a2a-ad5a-fdb03bc5f543/cleanup/0.log" Jun 09 12:12:09.898318 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:09.898233 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5778ccf7-t9jvt_c450ab80-3e80-45c2-8097-92f2e7ced800/manager/0.log" Jun 09 12:12:09.915751 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:09.915725 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-f5778ccf7-t9jvt_c450ab80-3e80-45c2-8097-92f2e7ced800/copy-manifests/0.log" Jun 09 12:12:10.715963 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:10.715931 2578 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-j58gl/perf-node-gather-daemonset-2x9v8" Jun 09 12:12:11.560042 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:11.560003 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-5f79d99c7-mbxht_ad11a06d-a04a-4a49-af69-7a45d2d4324d/manager/0.log" Jun 09 12:12:16.655111 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:16.655054 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cb988c7-jxvv5_b6004faa-a8fd-4651-afe1-7a6c3af8aab8/kube-auth-proxy/0.log" Jun 09 12:12:16.751352 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:16.751321 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6d5kt_b92d3679-3929-4157-b1aa-972086ae531a/payload-pre-processing/0.log" Jun 09 12:12:17.693905 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:17.693874 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pdrz8_b91d017f-f098-47a4-94a1-5215375159f7/kube-storage-version-migrator-operator/1.log" Jun 09 12:12:17.694754 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:17.694724 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-55bb7c4d49-pdrz8_b91d017f-f098-47a4-94a1-5215375159f7/kube-storage-version-migrator-operator/0.log" Jun 09 12:12:18.064010 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.063981 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cb988c7-jxvv5_b6004faa-a8fd-4651-afe1-7a6c3af8aab8/kube-auth-proxy/0.log" Jun 09 12:12:18.168755 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.168716 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6d5kt_b92d3679-3929-4157-b1aa-972086ae531a/payload-pre-processing/0.log" Jun 09 12:12:18.862315 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.862292 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/kube-multus-additional-cni-plugins/0.log" Jun 09 12:12:18.884822 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.884798 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/egress-router-binary-copy/0.log" Jun 09 12:12:18.906303 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.906265 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/cni-plugins/0.log" Jun 09 12:12:18.928340 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.928244 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/bond-cni-plugin/0.log" Jun 09 12:12:18.950315 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.950288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/routeoverride-cni/0.log" Jun 09 12:12:18.971928 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.971903 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/whereabouts-cni-bincopy/0.log" Jun 09 12:12:18.995097 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:18.995070 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-dphf5_ab4b9db6-a1b0-4977-a0b1-b4da0299397c/whereabouts-cni/0.log" Jun 09 12:12:19.396606 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:19.396575 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-pndrm_a82bef92-db54-4d30-9e34-77a4d58684a2/kube-multus/0.log" Jun 09 12:12:19.482941 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:19.482913 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wq7cp_b4c17869-8277-4de5-bf8e-f7c78f6e548b/network-metrics-daemon/0.log" Jun 09 12:12:19.503848 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:19.503816 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wq7cp_b4c17869-8277-4de5-bf8e-f7c78f6e548b/kube-rbac-proxy/0.log" Jun 09 12:12:19.824948 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:19.824923 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7b6cb988c7-jxvv5_b6004faa-a8fd-4651-afe1-7a6c3af8aab8/kube-auth-proxy/0.log" Jun 09 12:12:19.926337 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:19.926308 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-67d7689b65-6d5kt_b92d3679-3929-4157-b1aa-972086ae531a/payload-pre-processing/0.log" Jun 09 12:12:20.571424 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.571379 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-controller/0.log" Jun 09 12:12:20.601783 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.601757 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/1.log" Jun 09 12:12:20.601783 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.601781 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovn-acl-logging/0.log" Jun 09 12:12:20.623240 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.623212 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/kube-rbac-proxy-node/0.log" Jun 09 12:12:20.645678 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.645637 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/kube-rbac-proxy-ovn-metrics/0.log" Jun 09 12:12:20.665638 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.665610 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/northd/0.log" Jun 09 12:12:20.687389 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.687307 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/nbdb/0.log" Jun 09 12:12:20.716612 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.716584 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/sbdb/0.log" Jun 09 12:12:20.789325 ip-10-0-128-244 kubenswrapper[2578]: I0609 12:12:20.789288 2578 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-898tr_56276743-73aa-4f34-ba84-e27c624a2b2e/ovnkube-controller/0.log"