Jun 12 20:09:41.020068 ip-10-0-137-64 systemd[1]: Starting Kubernetes Kubelet... Jun 12 20:09:41.424994 ip-10-0-137-64 kubenswrapper[2579]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:41.424994 ip-10-0-137-64 kubenswrapper[2579]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 20:09:41.424994 ip-10-0-137-64 kubenswrapper[2579]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:41.424994 ip-10-0-137-64 kubenswrapper[2579]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 20:09:41.424994 ip-10-0-137-64 kubenswrapper[2579]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 20:09:41.425595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.424998 2579 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 20:09:41.430761 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430746 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.430761 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430760 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430764 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430768 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430771 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430774 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430777 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430780 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430783 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430786 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430788 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430804 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430807 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430810 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430813 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430815 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430818 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430820 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430828 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430831 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430833 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.430872 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430836 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430838 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430842 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430847 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430850 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430852 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430855 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430858 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430861 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430864 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430868 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430877 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430880 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430883 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430886 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430889 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430892 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430894 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430897 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.431346 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430900 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430902 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430904 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430907 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430909 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430912 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430916 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430918 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430926 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430929 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430931 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430933 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430936 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430938 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430941 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430943 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430946 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430949 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430951 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430956 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.431873 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430960 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430963 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430965 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430968 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430970 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430973 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430976 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430978 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430981 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430983 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430986 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430988 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430991 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430993 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430997 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.430999 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431002 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431004 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431006 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431009 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.432347 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431011 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431019 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431022 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431024 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431027 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431031 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431034 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431037 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431040 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431043 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431046 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431048 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431051 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431053 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431056 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431058 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431061 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431064 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.431066 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.432831 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432710 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432717 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432721 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432724 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432727 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432730 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432733 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432735 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432738 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432741 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432743 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432746 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432749 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432751 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432754 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432756 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432759 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432762 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432764 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432767 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.433291 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432770 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432773 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432776 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432779 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432781 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432784 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432786 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432788 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432810 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432815 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432818 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432821 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432824 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432828 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432830 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432834 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432837 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432840 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432843 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.433777 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432846 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432849 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432852 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432855 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432857 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432860 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432862 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432865 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432867 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432870 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432873 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432875 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432878 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432882 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432884 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432887 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432890 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432893 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432895 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432898 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.434254 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432900 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432905 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432909 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432912 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432914 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432917 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432920 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432922 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432924 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432927 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432929 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432932 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432934 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432937 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432939 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432941 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432944 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432947 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432949 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.434742 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432952 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432954 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432957 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432960 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432962 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432965 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432968 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432971 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432974 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432977 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432980 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432982 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432984 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432987 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432989 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432992 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432995 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.432999 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433002 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.435214 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433005 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433007 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433362 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433366 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433369 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433372 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433374 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433377 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433379 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433382 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433384 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433387 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433389 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433392 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433394 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433397 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433400 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433402 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433405 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433408 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.435677 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433411 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433413 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433416 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433418 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433421 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433424 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433426 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433430 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433434 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433437 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433439 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433442 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433446 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433450 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433453 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433455 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433458 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433461 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433463 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.436175 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433466 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433469 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433472 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433474 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433477 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433480 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433484 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433487 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433489 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433492 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433495 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433498 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433501 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433504 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433507 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433509 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433512 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433514 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433517 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433519 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.436667 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433522 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433524 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433527 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433529 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433532 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433534 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433537 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433539 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433541 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433544 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433547 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433549 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433551 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433554 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433556 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433559 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433561 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433563 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433566 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433570 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.437165 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433572 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433575 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433578 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433581 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433583 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433586 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433589 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433591 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433594 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433596 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433599 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433601 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433603 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433606 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433608 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433611 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433614 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433616 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433619 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433621 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.437651 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433624 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.433626 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433694 2579 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433701 2579 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433709 2579 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433716 2579 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433721 2579 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433726 2579 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433732 2579 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433736 2579 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433740 2579 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433743 2579 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433746 2579 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433749 2579 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433752 2579 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433755 2579 flags.go:64] FLAG: --cgroup-root="" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433762 2579 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433765 2579 flags.go:64] FLAG: --client-ca-file="" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433768 2579 flags.go:64] FLAG: --cloud-provider="external" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433771 2579 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433775 2579 flags.go:64] FLAG: --cluster-domain="" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433778 2579 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433781 2579 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433784 2579 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 20:09:41.438151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433788 2579 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433804 2579 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433807 2579 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433810 2579 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433814 2579 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433816 2579 flags.go:64] FLAG: --contention-profiling="false" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433819 2579 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433822 2579 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433825 2579 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433828 2579 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433832 2579 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433835 2579 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433838 2579 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433840 2579 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433843 2579 flags.go:64] FLAG: --enable-server="true" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433846 2579 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433851 2579 flags.go:64] FLAG: --event-burst="100" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433854 2579 flags.go:64] FLAG: --event-qps="50" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433857 2579 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433860 2579 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433862 2579 flags.go:64] FLAG: --eviction-hard="" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433866 2579 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433869 2579 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433872 2579 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433875 2579 flags.go:64] FLAG: --eviction-soft="" Jun 12 20:09:41.438724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433879 2579 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433882 2579 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433885 2579 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433887 2579 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433890 2579 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433893 2579 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433896 2579 flags.go:64] FLAG: --feature-gates="" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433899 2579 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433902 2579 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433905 2579 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433908 2579 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433910 2579 flags.go:64] FLAG: --healthz-port="10248" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433913 2579 flags.go:64] FLAG: --help="false" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433916 2579 flags.go:64] FLAG: --hostname-override="ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433919 2579 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433922 2579 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433924 2579 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433928 2579 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433931 2579 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433934 2579 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433936 2579 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433945 2579 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433948 2579 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 20:09:41.439325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433951 2579 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433954 2579 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433957 2579 flags.go:64] FLAG: --kube-reserved="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433960 2579 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433962 2579 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433966 2579 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433969 2579 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433971 2579 flags.go:64] FLAG: --lock-file="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433974 2579 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433977 2579 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433980 2579 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433985 2579 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433988 2579 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433991 2579 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433994 2579 flags.go:64] FLAG: --logging-format="text" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.433997 2579 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434000 2579 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434003 2579 flags.go:64] FLAG: --manifest-url="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434006 2579 flags.go:64] FLAG: --manifest-url-header="" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434009 2579 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434012 2579 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434016 2579 flags.go:64] FLAG: --max-pods="110" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434019 2579 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434022 2579 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434025 2579 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 20:09:41.439966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434028 2579 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434030 2579 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434033 2579 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434036 2579 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434043 2579 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434047 2579 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434050 2579 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434053 2579 flags.go:64] FLAG: --pod-cidr="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434056 2579 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434061 2579 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434064 2579 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434066 2579 flags.go:64] FLAG: --pods-per-core="0" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434069 2579 flags.go:64] FLAG: --port="10250" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434072 2579 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434078 2579 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-04854743f2489f1aa" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434082 2579 flags.go:64] FLAG: --qos-reserved="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434085 2579 flags.go:64] FLAG: --read-only-port="10255" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434088 2579 flags.go:64] FLAG: --register-node="true" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434091 2579 flags.go:64] FLAG: --register-with-taints="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434094 2579 flags.go:64] FLAG: --registry-burst="10" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434097 2579 flags.go:64] FLAG: --registry-qps="5" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434100 2579 flags.go:64] FLAG: --reserved-cpus="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434103 2579 flags.go:64] FLAG: --reserved-memory="" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434107 2579 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434110 2579 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 20:09:41.440577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434112 2579 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434115 2579 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434118 2579 flags.go:64] FLAG: --runonce="false" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434121 2579 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434124 2579 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434127 2579 flags.go:64] FLAG: --seccomp-default="false" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434129 2579 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434132 2579 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434135 2579 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434138 2579 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434141 2579 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434143 2579 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434147 2579 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434150 2579 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434153 2579 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434156 2579 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434159 2579 flags.go:64] FLAG: --system-cgroups="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434161 2579 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434167 2579 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434169 2579 flags.go:64] FLAG: --tls-cert-file="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434172 2579 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434177 2579 flags.go:64] FLAG: --tls-min-version="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434180 2579 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434183 2579 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434186 2579 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 20:09:41.441383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434188 2579 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434192 2579 flags.go:64] FLAG: --v="2" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434195 2579 flags.go:64] FLAG: --version="false" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434199 2579 flags.go:64] FLAG: --vmodule="" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434203 2579 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.434206 2579 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434316 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434319 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434322 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434325 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434328 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434330 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434333 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434336 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434338 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434341 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434343 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434345 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434348 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434352 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434354 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.442111 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434357 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434360 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434362 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434365 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434367 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434370 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434372 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434376 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434378 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434381 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434383 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434386 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434388 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434392 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434394 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434397 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434399 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434402 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434404 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.442619 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434407 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434410 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434412 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434416 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434420 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434423 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434426 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434428 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434431 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434433 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434436 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434440 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434442 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434445 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434447 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434450 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434452 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434455 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434458 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434460 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.443091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434464 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434466 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434470 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434474 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434477 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434480 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434483 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434486 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434489 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434492 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434494 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434497 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434500 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434502 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434505 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434507 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434510 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434512 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434515 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434517 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.443587 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434519 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434522 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434524 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434528 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434531 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434533 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434536 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434538 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434541 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434544 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434546 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434549 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434552 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434555 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434558 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434561 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434565 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434567 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434570 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.444091 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434573 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434575 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434578 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434581 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434583 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.434586 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.435304 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.442864 2579 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.442880 2579 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.443689 2579 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.443702 2579 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443757 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443762 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443765 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443768 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.444540 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443771 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443774 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443777 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443779 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443782 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443784 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443788 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443804 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443807 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443812 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443816 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443819 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443822 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443826 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443829 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443832 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443834 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443837 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443841 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443843 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.444917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443846 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443849 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443852 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443855 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443857 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443860 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443863 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443866 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443868 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443871 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443873 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443876 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443878 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443881 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443884 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443886 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443889 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443891 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443894 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443897 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.445393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443899 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443902 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443904 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443906 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443909 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443913 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443915 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443918 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443920 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443923 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443926 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443929 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443931 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443934 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443937 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443939 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443942 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443944 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443947 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.445922 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443949 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443952 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443956 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443959 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443962 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443965 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443968 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443971 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443973 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443976 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443978 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443981 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443984 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443986 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443989 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443991 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443995 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.443997 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444000 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.446393 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444002 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444005 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444007 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444010 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444013 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444016 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444019 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444023 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444026 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444028 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444031 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444034 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444036 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444038 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444041 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444043 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.446861 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444046 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.444051 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444170 2579 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444175 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444178 2579 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444181 2579 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444184 2579 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444187 2579 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444190 2579 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444193 2579 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444197 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444200 2579 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444203 2579 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444207 2579 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444211 2579 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 20:09:41.447239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444214 2579 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444217 2579 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444220 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444224 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444227 2579 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444229 2579 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444232 2579 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444235 2579 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444238 2579 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444242 2579 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444244 2579 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444247 2579 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444250 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444253 2579 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444256 2579 feature_gate.go:328] unrecognized feature gate: Example Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444259 2579 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444262 2579 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444264 2579 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444267 2579 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444270 2579 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 20:09:41.447622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444273 2579 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444275 2579 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444278 2579 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444280 2579 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444283 2579 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444285 2579 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444288 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444291 2579 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444293 2579 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444296 2579 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444298 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444301 2579 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444304 2579 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444306 2579 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444309 2579 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444312 2579 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444314 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444317 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444319 2579 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 20:09:41.448172 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444322 2579 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444324 2579 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444327 2579 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444329 2579 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444332 2579 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444335 2579 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444337 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444340 2579 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444342 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444344 2579 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444347 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444350 2579 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444352 2579 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444355 2579 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444357 2579 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444360 2579 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444362 2579 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444365 2579 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444367 2579 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444370 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 20:09:41.448622 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444372 2579 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444375 2579 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444377 2579 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444380 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444382 2579 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444384 2579 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444388 2579 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444390 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444393 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444396 2579 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444398 2579 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444401 2579 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444403 2579 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444406 2579 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444410 2579 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444414 2579 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444416 2579 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444419 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444421 2579 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 20:09:41.449143 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444424 2579 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444426 2579 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444429 2579 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444431 2579 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444434 2579 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444436 2579 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444439 2579 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:41.444443 2579 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.444448 2579 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.444548 2579 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.446672 2579 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.448302 2579 server.go:1019] "Starting client certificate rotation" Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.448399 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 20:09:41.449596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.448437 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 20:09:41.450706 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.450691 2579 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 20:09:41.453668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.453654 2579 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 20:09:41.461896 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.461858 2579 log.go:25] "Validated CRI v1 runtime API" Jun 12 20:09:41.464492 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.464474 2579 log.go:25] "Validated CRI v1 image API" Jun 12 20:09:41.465926 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.465908 2579 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 20:09:41.469250 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.469223 2579 fs.go:135] Filesystem UUIDs: map[5f45c637-8dce-4226-89e4-dbc0a4deb55b:/dev/nvme0n1p4 75d31c60-5cd8-41b1-867c-6fa07ec0ab27:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2] Jun 12 20:09:41.469358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.469247 2579 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 20:09:41.474288 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.474183 2579 manager.go:216] Machine: {Timestamp:2026-06-12 20:09:41.472644235 +0000 UTC m=+0.343069470 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100773 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2bdbfa2969f458d4b45f391148389b SystemUUID:ec2bdbfa-2969-f458-d4b4-5f391148389b BootID:0e81335c-d0af-4e65-817e-8c53dc5480a3 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:f8:08:2b:40:33 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:f8:08:2b:40:33 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:8e:9c:5d:11:55:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 20:09:41.474288 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.474277 2579 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 20:09:41.474422 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.474344 2579 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 20:09:41.477508 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.477480 2579 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 20:09:41.477648 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.477510 2579 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-137-64.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 20:09:41.478287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.478275 2579 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 20:09:41.478287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.478286 2579 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 20:09:41.478371 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.478294 2579 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 20:09:41.478966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.478956 2579 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 20:09:41.480285 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.480276 2579 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 20:09:41.483087 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483068 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 12 20:09:41.483463 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483451 2579 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 20:09:41.483531 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483485 2579 kubelet.go:486] "Attempting to sync node with API server" Jun 12 20:09:41.483531 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483506 2579 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 20:09:41.483531 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483521 2579 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 20:09:41.483531 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483532 2579 kubelet.go:398] "Adding apiserver pod source" Jun 12 20:09:41.483684 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483545 2579 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 20:09:41.483944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483931 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 20:09:41.484029 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.483950 2579 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 20:09:41.485010 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.484991 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 20:09:41.485861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.485843 2579 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 20:09:41.487050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487034 2579 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 20:09:41.487134 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487073 2579 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 20:09:41.487857 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487844 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487866 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487874 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487882 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487894 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487903 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487915 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487923 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 20:09:41.487937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487932 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 20:09:41.488166 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487941 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 20:09:41.488166 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487954 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 20:09:41.488166 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.487963 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 20:09:41.488667 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.488657 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 20:09:41.488721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.488669 2579 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 20:09:41.491716 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.491700 2579 server.go:1268] "Started kubelet" Jun 12 20:09:41.491812 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.491757 2579 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 20:09:41.491975 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.491929 2579 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 20:09:41.492074 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.492063 2579 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 20:09:41.492602 ip-10-0-137-64 systemd[1]: Started Kubernetes Kubelet. Jun 12 20:09:41.493835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.493817 2579 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 20:09:41.493964 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.493953 2579 server.go:310] "Adding debug handlers to kubelet server" Jun 12 20:09:41.496097 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.496055 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-137-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jun 12 20:09:41.496193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.496115 2579 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-137-64.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 20:09:41.496193 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.496114 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 20:09:41.497873 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.497857 2579 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 20:09:41.497955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.497873 2579 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 20:09:41.498011 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.497963 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.498491 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.498472 2579 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 20:09:41.498491 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.498475 2579 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 20:09:41.498635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.498501 2579 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 20:09:41.498635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.498561 2579 reconstruct.go:97] "Volume reconstruction finished" Jun 12 20:09:41.498635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.498570 2579 reconciler.go:29] "Reconciler: start to sync state" Jun 12 20:09:41.499252 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499118 2579 factory.go:55] Registering systemd factory Jun 12 20:09:41.499252 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499140 2579 factory.go:223] Registration of the systemd container factory successfully Jun 12 20:09:41.499391 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.497940 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-64.ec2.internal.18b86e5913ff519b default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-64.ec2.internal,UID:ip-10-0-137-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-137-64.ec2.internal,},FirstTimestamp:2026-06-12 20:09:41.491675547 +0000 UTC m=+0.362100782,LastTimestamp:2026-06-12 20:09:41.491675547 +0000 UTC m=+0.362100782,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-64.ec2.internal,}" Jun 12 20:09:41.499569 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499555 2579 factory.go:153] Registering CRI-O factory Jun 12 20:09:41.499648 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499637 2579 factory.go:223] Registration of the crio container factory successfully Jun 12 20:09:41.499778 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499755 2579 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 20:09:41.499880 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499782 2579 factory.go:103] Registering Raw factory Jun 12 20:09:41.499880 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.499814 2579 manager.go:1196] Started watching for new ooms in manager Jun 12 20:09:41.500325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.500161 2579 manager.go:349] Starting recovery of all containers Jun 12 20:09:41.500325 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.500271 2579 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 20:09:41.510740 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.510716 2579 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-137-64.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jun 12 20:09:41.511236 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.511208 2579 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jun 12 20:09:41.512100 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.512082 2579 manager.go:354] Recovery completed Jun 12 20:09:41.515958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.515944 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.517814 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.517784 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.517869 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.517826 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.517869 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.517836 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.518281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518267 2579 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 20:09:41.518281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518280 2579 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 20:09:41.518350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518294 2579 state_mem.go:36] "Initialized new in-memory state store" Jun 12 20:09:41.518350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518313 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.518946 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518933 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.518996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518959 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.518996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.518971 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.519458 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.519447 2579 policy_none.go:49] "None policy: Start" Jun 12 20:09:41.519488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.519463 2579 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 20:09:41.519488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.519475 2579 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 20:09:41.520389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.520379 2579 policy_none.go:47] "Start" Jun 12 20:09:41.521346 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.521282 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-64.ec2.internal.18b86e59158e1e91 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-64.ec2.internal,UID:ip-10-0-137-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-137-64.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-137-64.ec2.internal,},FirstTimestamp:2026-06-12 20:09:41.517811345 +0000 UTC m=+0.388236580,LastTimestamp:2026-06-12 20:09:41.517811345 +0000 UTC m=+0.388236580,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-64.ec2.internal,}" Jun 12 20:09:41.532377 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.532360 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zcqf" Jun 12 20:09:41.536087 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.536033 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-64.ec2.internal.18b86e59158e6a66 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-64.ec2.internal,UID:ip-10-0-137-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-137-64.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-137-64.ec2.internal,},FirstTimestamp:2026-06-12 20:09:41.517830758 +0000 UTC m=+0.388255994,LastTimestamp:2026-06-12 20:09:41.517830758 +0000 UTC m=+0.388255994,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-64.ec2.internal,}" Jun 12 20:09:41.543958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.543940 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-9zcqf" Jun 12 20:09:41.546755 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.546690 2579 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-137-64.ec2.internal.18b86e59158e8d07 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-137-64.ec2.internal,UID:ip-10-0-137-64.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-137-64.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-137-64.ec2.internal,},FirstTimestamp:2026-06-12 20:09:41.517839623 +0000 UTC m=+0.388264859,LastTimestamp:2026-06-12 20:09:41.517839623 +0000 UTC m=+0.388264859,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-137-64.ec2.internal,}" Jun 12 20:09:41.555686 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.555671 2579 manager.go:337] "Starting Device Plugin manager" Jun 12 20:09:41.555771 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.555704 2579 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 20:09:41.555771 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.555718 2579 server.go:87] "Starting device plugin registration server" Jun 12 20:09:41.556014 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.555942 2579 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 20:09:41.556014 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.555954 2579 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 20:09:41.556277 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.556068 2579 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 20:09:41.556504 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.556488 2579 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 20:09:41.556504 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.556504 2579 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 20:09:41.556699 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.556683 2579 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 20:09:41.556757 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.556732 2579 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.567465 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.567447 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 20:09:41.568524 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.568509 2579 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 20:09:41.568578 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.568543 2579 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 20:09:41.568578 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.568562 2579 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 20:09:41.568679 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.568589 2579 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 20:09:41.570850 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.570826 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:41.656372 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.656352 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.657333 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.657318 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.657420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.657349 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.657420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.657367 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.657420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.657388 2579 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.666950 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.666933 2579 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.666998 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.666953 2579 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-137-64.ec2.internal\": node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.668660 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.668644 2579 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal"] Jun 12 20:09:41.668707 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.668698 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.669355 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.669338 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.669425 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.669371 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.669425 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.669386 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.670938 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.670924 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.671040 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671027 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.671088 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671054 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.671553 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671538 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.671618 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671569 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.671618 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671583 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.671717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671537 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.671717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671641 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.671717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.671653 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.672663 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.672643 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.672744 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.672673 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:41.673276 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.673259 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:41.673334 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.673284 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:41.673334 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.673293 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:41.689201 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.689185 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.692395 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.692379 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-64.ec2.internal\" not found" node="ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.696725 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.696709 2579 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-137-64.ec2.internal\" not found" node="ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.699891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.699875 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.699958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.699898 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.699958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.699915 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3de76128908ab97fc26daab2e5570029-config\") pod \"kube-apiserver-proxy-ip-10-0-137-64.ec2.internal\" (UID: \"3de76128908ab97fc26daab2e5570029\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.789829 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.789812 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.800376 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800349 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3de76128908ab97fc26daab2e5570029-config\") pod \"kube-apiserver-proxy-ip-10-0-137-64.ec2.internal\" (UID: \"3de76128908ab97fc26daab2e5570029\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.800461 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800379 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.800461 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800395 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.800461 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.800461 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800436 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/3de76128908ab97fc26daab2e5570029-config\") pod \"kube-apiserver-proxy-ip-10-0-137-64.ec2.internal\" (UID: \"3de76128908ab97fc26daab2e5570029\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.800603 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.800461 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/476954021ee69e62ad4fe91157fd7a93-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal\" (UID: \"476954021ee69e62ad4fe91157fd7a93\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.890368 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.890340 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.990704 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:41.990683 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:41.994838 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.994825 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:41.999886 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:41.999860 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:42.090878 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.090839 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.191879 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.191852 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.292357 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.292298 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.392856 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.392827 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.447277 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.447251 2579 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 20:09:42.447772 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.447427 2579 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 20:09:42.493743 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.493723 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.521594 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:42.521555 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3de76128908ab97fc26daab2e5570029.slice/crio-ef0701ee08a7e73ea7c049d8be8a0eb05389991901ef46bcbdea027bbd05554a WatchSource:0}: Error finding container ef0701ee08a7e73ea7c049d8be8a0eb05389991901ef46bcbdea027bbd05554a: Status 404 returned error can't find the container with id ef0701ee08a7e73ea7c049d8be8a0eb05389991901ef46bcbdea027bbd05554a Jun 12 20:09:42.522085 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:42.522061 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod476954021ee69e62ad4fe91157fd7a93.slice/crio-06516768f1695b9dbe6062def6744b9d9cf1c585b63755021f3094f6887ed59f WatchSource:0}: Error finding container 06516768f1695b9dbe6062def6744b9d9cf1c585b63755021f3094f6887ed59f: Status 404 returned error can't find the container with id 06516768f1695b9dbe6062def6744b9d9cf1c585b63755021f3094f6887ed59f Jun 12 20:09:42.526609 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.526593 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:09:42.547847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.547785 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 20:04:41 +0000 UTC" deadline="2028-03-05 08:09:56.816966622 +0000 UTC" Jun 12 20:09:42.547847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.547820 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15156h0m14.269149586s" Jun 12 20:09:42.572064 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.572016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" event={"ID":"476954021ee69e62ad4fe91157fd7a93","Type":"ContainerStarted","Data":"06516768f1695b9dbe6062def6744b9d9cf1c585b63755021f3094f6887ed59f"} Jun 12 20:09:42.572948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.572929 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" event={"ID":"3de76128908ab97fc26daab2e5570029","Type":"ContainerStarted","Data":"ef0701ee08a7e73ea7c049d8be8a0eb05389991901ef46bcbdea027bbd05554a"} Jun 12 20:09:42.594085 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.594067 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.605487 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.605474 2579 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 20:09:42.606935 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.606919 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientMemory" Jun 12 20:09:42.606993 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.606947 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 20:09:42.606993 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.606957 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeHasSufficientPID" Jun 12 20:09:42.608837 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.608823 2579 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:42.694198 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:42.694175 2579 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-137-64.ec2.internal\" not found" Jun 12 20:09:42.711682 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.711664 2579 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:42.712186 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.712172 2579 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:42.798988 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.798929 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" Jun 12 20:09:42.811325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.811310 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 20:09:42.812344 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.812331 2579 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" Jun 12 20:09:42.828004 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:42.827988 2579 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 20:09:43.484826 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.484783 2579 apiserver.go:52] "Watching apiserver" Jun 12 20:09:43.491986 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.491959 2579 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 20:09:43.492310 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.492286 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-qzv8j","kube-system/konnectivity-agent-hznww","openshift-cluster-node-tuning-operator/tuned-q9fsz","openshift-image-registry/node-ca-q8p5x","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal","openshift-multus/multus-additional-cni-plugins-mcwpv","openshift-multus/multus-hr8l9","openshift-multus/network-metrics-daemon-gldlc","kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t","openshift-dns/node-resolver-ffk9h","openshift-network-diagnostics/network-check-target-229hn","openshift-network-operator/iptables-alerter-fz282","openshift-ovn-kubernetes/ovnkube-node-scr5q"] Jun 12 20:09:43.493737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.493717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.494967 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.494713 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.495880 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.495858 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.496286 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496263 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.496378 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496292 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-v6gb7\"" Jun 12 20:09:43.496378 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496301 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 20:09:43.496378 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496311 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 20:09:43.496378 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496376 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.496811 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496759 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.497063 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.496999 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.497762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.497062 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.498215 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.497975 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-g5pjm\"" Jun 12 20:09:43.499870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.498852 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.499870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.498985 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-wqbp2\"" Jun 12 20:09:43.499870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.499165 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.499870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.499380 2579 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 20:09:43.499870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.499571 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.500381 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.500360 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.500510 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.500360 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 20:09:43.501149 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.500992 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-6pqpm\"" Jun 12 20:09:43.501149 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.501086 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.501699 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.501631 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.502350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.502333 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.502453 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.502424 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:43.503778 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.503759 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.504055 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.503902 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 20:09:43.504055 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.503915 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-5k9bt\"" Jun 12 20:09:43.504055 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.504050 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.505156 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505137 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.505561 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505540 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6px6v\"" Jun 12 20:09:43.505631 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505568 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 20:09:43.505631 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505585 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 20:09:43.505905 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505886 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 20:09:43.505979 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505955 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.506038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.505956 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 20:09:43.506178 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506156 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.506238 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506197 2579 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 20:09:43.506390 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506374 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 20:09:43.506390 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506387 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.506515 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506407 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 20:09:43.506833 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506806 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.506924 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.506908 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-fkzkk\"" Jun 12 20:09:43.507636 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.507618 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 20:09:43.507896 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.507873 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.508004 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.507941 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:43.508609 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508587 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-os-release\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.508701 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508622 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.508701 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508647 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-system-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.508701 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508671 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-daemon-config\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.508847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508718 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d200bc-f584-417e-9d47-826ad9507d62-tmp-dir\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.508847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508745 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-systemd\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.508847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-tmp\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.508847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508838 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbc778f6-80ac-4480-bc10-55479741f6ba-host\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508870 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wrkl4\" (UniqueName: \"kubernetes.io/projected/25b3b276-4d53-47d7-a416-179d75cac87d-kube-api-access-wrkl4\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508897 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508920 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-kubelet\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-etc-tuned\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508970 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-env-overrides\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.508995 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/caa22a41-9a32-4717-ba35-febd79e79a15-kube-api-access-96nf7\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.509038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509019 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-var-lib-kubelet\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509041 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hbmvm\" (UniqueName: \"kubernetes.io/projected/cbc778f6-80ac-4480-bc10-55479741f6ba-kube-api-access-hbmvm\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509063 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-systemd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509085 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-node-log\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509153 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-multus-certs\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509176 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysconfig\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-conf\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509244 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-sys\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509294 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-systemd-units\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509324 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.509382 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509329 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-netns\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509450 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509483 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-bin\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mmgwt\" (UniqueName: \"kubernetes.io/projected/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-kube-api-access-mmgwt\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509560 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509576 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cni-binary-copy\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-netns\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509610 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9j57\" (UniqueName: \"kubernetes.io/projected/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-kube-api-access-g9j57\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509630 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbc778f6-80ac-4480-bc10-55479741f6ba-serviceca\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-cnibin\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509675 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-k8s-cni-cncf-io\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509690 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-bin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509708 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cnibin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509732 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-socket-dir-parent\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.509907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509759 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-hostroot\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509806 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjcbs\" (UniqueName: \"kubernetes.io/projected/e8d200bc-f584-417e-9d47-826ad9507d62-kube-api-access-fjcbs\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509831 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-slash\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509858 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-var-lib-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-run\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.509947 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-netd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510008 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-config\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510029 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-system-cni-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510069 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-conf-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510094 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-lib-modules\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510130 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-os-release\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510190 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-multus\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510207 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-etc-kubernetes\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510221 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-modprobe-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.510633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510235 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-host\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510256 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-ovn\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510278 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d200bc-f584-417e-9d47-826ad9507d62-hosts-file\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510328 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-kubernetes\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510349 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-etc-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510375 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovn-node-metrics-cert\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510397 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-script-lib\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510406 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-jxbb4\"" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510421 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-kubelet\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510442 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-log-socket\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510626 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510677 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510699 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.510927 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 20:09:43.511335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.511010 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-qkz8g\"" Jun 12 20:09:43.513175 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.513148 2579 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 20:09:43.533369 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.533352 2579 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8lvw" Jun 12 20:09:43.541963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.541944 2579 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-g8lvw" Jun 12 20:09:43.600320 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.600294 2579 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 20:09:43.611438 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611412 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-systemd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-node-log\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-multus-certs\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611517 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611539 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysconfig\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-systemd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611538 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-node-log\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611581 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611608 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-conf\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-sys\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611632 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysconfig\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-systemd-units\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611671 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-netns\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611682 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-sys\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611701 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611716 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-multus-certs\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-bin\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611749 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mmgwt\" (UniqueName: \"kubernetes.io/projected/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-kube-api-access-mmgwt\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611761 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-systemd-units\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611773 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611789 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-sysctl-conf\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.611835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611818 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cni-binary-copy\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611818 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611851 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-run-netns\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.611893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-bin\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612021 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-netns\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612051 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9j57\" (UniqueName: \"kubernetes.io/projected/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-kube-api-access-g9j57\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbc778f6-80ac-4480-bc10-55479741f6ba-serviceca\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612077 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-netns\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612099 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612123 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-registration-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612147 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612172 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-cnibin\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612196 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-k8s-cni-cncf-io\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612218 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-bin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612246 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xp57h\" (UniqueName: \"kubernetes.io/projected/51b62985-38de-42e2-8d2a-4f786ef66027-kube-api-access-xp57h\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e28d3fc-14ed-442e-be78-9930417a5fa8-konnectivity-ca\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612289 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-dbus\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.612597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612317 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cnibin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612341 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-socket-dir-parent\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-device-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612389 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2k8mg\" (UniqueName: \"kubernetes.io/projected/8c934d81-4ca7-453b-8b5e-0801a3745b71-kube-api-access-2k8mg\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612408 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cni-binary-copy\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612414 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-kubelet-config\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612438 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-hostroot\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612496 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjcbs\" (UniqueName: \"kubernetes.io/projected/e8d200bc-f584-417e-9d47-826ad9507d62-kube-api-access-fjcbs\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612512 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-hostroot\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612524 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-slash\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-var-lib-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612592 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-socket-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612618 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-socket-dir-parent\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612641 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-run\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.613396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612674 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-netd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612689 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-run\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-run-k8s-cni-cncf-io\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612698 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-config\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612734 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-sys-fs\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-system-cni-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-conf-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612830 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-lib-modules\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612853 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612876 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-os-release\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612899 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-multus\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612922 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-etc-kubernetes\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-slash\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612945 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-modprobe-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612969 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-host\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612593 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-cnibin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-ovn\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613057 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-run-ovn\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.614164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613109 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-cnibin\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613153 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-system-cni-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613187 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-conf-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-config\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613300 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-lib-modules\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613304 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-bin\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613352 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-cni-netd\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613390 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-etc-kubernetes\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613446 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-os-release\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613468 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613471 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/cbc778f6-80ac-4480-bc10-55479741f6ba-serviceca\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613482 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-cni-multus\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613489 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.612968 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-var-lib-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613527 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613530 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-host\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613553 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d200bc-f584-417e-9d47-826ad9507d62-hosts-file\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613576 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-modprobe-d\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.615025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613578 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613616 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-kubernetes\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613668 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-kubernetes\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/e8d200bc-f584-417e-9d47-826ad9507d62-hosts-file\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613745 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-etc-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613777 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-etc-openvswitch\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613782 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovn-node-metrics-cert\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-script-lib\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51b62985-38de-42e2-8d2a-4f786ef66027-iptables-alerter-script\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613893 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51b62985-38de-42e2-8d2a-4f786ef66027-host-slash\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-kubelet\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.613976 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-log-socket\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614006 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-host-kubelet\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5w4mv\" (UniqueName: \"kubernetes.io/projected/f3d69e07-ed28-422e-9944-4f3e0481a327-kube-api-access-5w4mv\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614081 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-log-socket\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-os-release\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.615721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614176 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/caa22a41-9a32-4717-ba35-febd79e79a15-os-release\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614217 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-system-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614225 2579 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614282 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-daemon-config\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614318 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-system-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614334 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovnkube-script-lib\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614365 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d200bc-f584-417e-9d47-826ad9507d62-tmp-dir\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614391 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-systemd\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-tmp\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614435 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbc778f6-80ac-4480-bc10-55479741f6ba-host\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614457 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wrkl4\" (UniqueName: \"kubernetes.io/projected/25b3b276-4d53-47d7-a416-179d75cac87d-kube-api-access-wrkl4\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614467 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-etc-systemd\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614487 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614523 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/cbc778f6-80ac-4480-bc10-55479741f6ba-host\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614525 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614564 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-kubelet\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614599 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e28d3fc-14ed-442e-be78-9930417a5fa8-agent-certs\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e8d200bc-f584-417e-9d47-826ad9507d62-tmp-dir\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.616453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-etc-tuned\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-env-overrides\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614684 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-host-var-lib-kubelet\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/caa22a41-9a32-4717-ba35-febd79e79a15-cni-binary-copy\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614719 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614728 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-cni-dir\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/caa22a41-9a32-4717-ba35-febd79e79a15-kube-api-access-96nf7\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614785 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-var-lib-kubelet\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614833 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-multus-daemon-config\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614848 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/25b3b276-4d53-47d7-a416-179d75cac87d-var-lib-kubelet\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.614873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hbmvm\" (UniqueName: \"kubernetes.io/projected/cbc778f6-80ac-4480-bc10-55479741f6ba-kube-api-access-hbmvm\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.617251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.615055 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-env-overrides\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.617737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.617485 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-tmp\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.617737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.617547 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/25b3b276-4d53-47d7-a416-179d75cac87d-etc-tuned\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.617737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.617715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-ovn-node-metrics-cert\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.620015 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.619991 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjcbs\" (UniqueName: \"kubernetes.io/projected/e8d200bc-f584-417e-9d47-826ad9507d62-kube-api-access-fjcbs\") pod \"node-resolver-ffk9h\" (UID: \"e8d200bc-f584-417e-9d47-826ad9507d62\") " pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.620270 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.620244 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mmgwt\" (UniqueName: \"kubernetes.io/projected/8518d8a7-4f34-4b98-af15-e5cc5d2f32b4-kube-api-access-mmgwt\") pod \"ovnkube-node-scr5q\" (UID: \"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4\") " pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.620501 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.620378 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9j57\" (UniqueName: \"kubernetes.io/projected/fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c-kube-api-access-g9j57\") pod \"multus-hr8l9\" (UID: \"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c\") " pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.622043 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.622012 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hbmvm\" (UniqueName: \"kubernetes.io/projected/cbc778f6-80ac-4480-bc10-55479741f6ba-kube-api-access-hbmvm\") pod \"node-ca-q8p5x\" (UID: \"cbc778f6-80ac-4480-bc10-55479741f6ba\") " pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.622324 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.622303 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wrkl4\" (UniqueName: \"kubernetes.io/projected/25b3b276-4d53-47d7-a416-179d75cac87d-kube-api-access-wrkl4\") pod \"tuned-q9fsz\" (UID: \"25b3b276-4d53-47d7-a416-179d75cac87d\") " pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.622750 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.622724 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96nf7\" (UniqueName: \"kubernetes.io/projected/caa22a41-9a32-4717-ba35-febd79e79a15-kube-api-access-96nf7\") pod \"multus-additional-cni-plugins-mcwpv\" (UID: \"caa22a41-9a32-4717-ba35-febd79e79a15\") " pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.715469 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715443 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51b62985-38de-42e2-8d2a-4f786ef66027-iptables-alerter-script\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.715619 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715484 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51b62985-38de-42e2-8d2a-4f786ef66027-host-slash\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.715619 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715510 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5w4mv\" (UniqueName: \"kubernetes.io/projected/f3d69e07-ed28-422e-9944-4f3e0481a327-kube-api-access-5w4mv\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.715619 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715574 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/51b62985-38de-42e2-8d2a-4f786ef66027-host-slash\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715621 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715653 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e28d3fc-14ed-442e-be78-9930417a5fa8-agent-certs\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715680 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715720 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-registration-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715813 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-registration-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.715861 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.715818 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715866 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.715918 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:44.215885158 +0000 UTC m=+3.086310402 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715938 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715963 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xp57h\" (UniqueName: \"kubernetes.io/projected/51b62985-38de-42e2-8d2a-4f786ef66027-kube-api-access-xp57h\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.715987 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e28d3fc-14ed-442e-be78-9930417a5fa8-konnectivity-ca\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716011 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-dbus\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716036 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-device-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716048 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-etc-selinux\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716059 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2k8mg\" (UniqueName: \"kubernetes.io/projected/8c934d81-4ca7-453b-8b5e-0801a3745b71-kube-api-access-2k8mg\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716105 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-kubelet-config\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716132 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-socket-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716195 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-sys-fs\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-device-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716202 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/51b62985-38de-42e2-8d2a-4f786ef66027-iptables-alerter-script\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-dbus\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716250 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/6af625a6-463a-466a-b491-6461e57cfde9-kubelet-config\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.716269 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716302 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-sys-fs\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.716309 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:44.216296181 +0000 UTC m=+3.086721412 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716339 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/8c934d81-4ca7-453b-8b5e-0801a3745b71-socket-dir\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.716785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.716642 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0e28d3fc-14ed-442e-be78-9930417a5fa8-konnectivity-ca\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.718040 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.718022 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0e28d3fc-14ed-442e-be78-9930417a5fa8-agent-certs\") pod \"konnectivity-agent-hznww\" (UID: \"0e28d3fc-14ed-442e-be78-9930417a5fa8\") " pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.724247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.724229 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xp57h\" (UniqueName: \"kubernetes.io/projected/51b62985-38de-42e2-8d2a-4f786ef66027-kube-api-access-xp57h\") pod \"iptables-alerter-fz282\" (UID: \"51b62985-38de-42e2-8d2a-4f786ef66027\") " pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.726149 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.726118 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:43.726149 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.726143 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:43.726289 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.726157 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:43.726289 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:43.726221 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:44.226206591 +0000 UTC m=+3.096631832 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:43.729708 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.729045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2k8mg\" (UniqueName: \"kubernetes.io/projected/8c934d81-4ca7-453b-8b5e-0801a3745b71-kube-api-access-2k8mg\") pod \"aws-ebs-csi-driver-node-zj84t\" (UID: \"8c934d81-4ca7-453b-8b5e-0801a3745b71\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:43.729708 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.729270 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5w4mv\" (UniqueName: \"kubernetes.io/projected/f3d69e07-ed28-422e-9944-4f3e0481a327-kube-api-access-5w4mv\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:43.807941 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.807888 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-hr8l9" Jun 12 20:09:43.815875 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.815856 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-ffk9h" Jun 12 20:09:43.821236 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.821220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" Jun 12 20:09:43.827716 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.827702 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-q8p5x" Jun 12 20:09:43.835266 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.835245 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:09:43.840698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.840679 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" Jun 12 20:09:43.847291 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.847277 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-fz282" Jun 12 20:09:43.853584 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.853566 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:09:43.858122 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:43.858104 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" Jun 12 20:09:44.218916 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.218837 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:44.218916 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.218886 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:44.219097 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.218981 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:44.219097 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.218997 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:44.219097 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.219041 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:45.219027972 +0000 UTC m=+4.089453207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:44.219097 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.219058 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:45.219050752 +0000 UTC m=+4.089475987 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:44.319893 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.319866 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:44.320055 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.320012 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:44.320055 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.320030 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:44.320055 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.320041 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:44.320221 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:44.320099 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:45.320082346 +0000 UTC m=+4.190507569 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:44.355048 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.355017 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaa22a41_9a32_4717_ba35_febd79e79a15.slice/crio-71b0c7c42ec854b2de59831546714f6a8a63c812ebcb7599a61603c9c448a4e9 WatchSource:0}: Error finding container 71b0c7c42ec854b2de59831546714f6a8a63c812ebcb7599a61603c9c448a4e9: Status 404 returned error can't find the container with id 71b0c7c42ec854b2de59831546714f6a8a63c812ebcb7599a61603c9c448a4e9 Jun 12 20:09:44.356038 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.356016 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8518d8a7_4f34_4b98_af15_e5cc5d2f32b4.slice/crio-324063077ae2367d9a9f9fcb831875337e49d6f0cb01bf31cb160569c270315e WatchSource:0}: Error finding container 324063077ae2367d9a9f9fcb831875337e49d6f0cb01bf31cb160569c270315e: Status 404 returned error can't find the container with id 324063077ae2367d9a9f9fcb831875337e49d6f0cb01bf31cb160569c270315e Jun 12 20:09:44.357448 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.357416 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51b62985_38de_42e2_8d2a_4f786ef66027.slice/crio-1ea7d1bd6109d27a32c02a7e06389f4939ef7213501a98c7815e14682b20c4f1 WatchSource:0}: Error finding container 1ea7d1bd6109d27a32c02a7e06389f4939ef7213501a98c7815e14682b20c4f1: Status 404 returned error can't find the container with id 1ea7d1bd6109d27a32c02a7e06389f4939ef7213501a98c7815e14682b20c4f1 Jun 12 20:09:44.360498 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.360479 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c934d81_4ca7_453b_8b5e_0801a3745b71.slice/crio-1d74fc4e09e07b8e1a97564f746fd7df9a3015131885b52ccc9b480e06dd9cb0 WatchSource:0}: Error finding container 1d74fc4e09e07b8e1a97564f746fd7df9a3015131885b52ccc9b480e06dd9cb0: Status 404 returned error can't find the container with id 1d74fc4e09e07b8e1a97564f746fd7df9a3015131885b52ccc9b480e06dd9cb0 Jun 12 20:09:44.361766 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.361746 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfcb516fc_dd07_4a2e_ab29_a307e7ed5c1c.slice/crio-c9b321646d2616216460787807846006a2afffe898d8a44dc14c6e060b5099f3 WatchSource:0}: Error finding container c9b321646d2616216460787807846006a2afffe898d8a44dc14c6e060b5099f3: Status 404 returned error can't find the container with id c9b321646d2616216460787807846006a2afffe898d8a44dc14c6e060b5099f3 Jun 12 20:09:44.362709 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.362682 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcbc778f6_80ac_4480_bc10_55479741f6ba.slice/crio-e9691554b716522cc0c01c9dd4ca1c8a6eef3945a3a241c83c1d9c8b30d047ae WatchSource:0}: Error finding container e9691554b716522cc0c01c9dd4ca1c8a6eef3945a3a241c83c1d9c8b30d047ae: Status 404 returned error can't find the container with id e9691554b716522cc0c01c9dd4ca1c8a6eef3945a3a241c83c1d9c8b30d047ae Jun 12 20:09:44.363330 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.363291 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode8d200bc_f584_417e_9d47_826ad9507d62.slice/crio-5be6c2ca47d06a6b9ac10b34564cdd4026274dbaeafa22798b89aad4b53cd08e WatchSource:0}: Error finding container 5be6c2ca47d06a6b9ac10b34564cdd4026274dbaeafa22798b89aad4b53cd08e: Status 404 returned error can't find the container with id 5be6c2ca47d06a6b9ac10b34564cdd4026274dbaeafa22798b89aad4b53cd08e Jun 12 20:09:44.364772 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:09:44.364621 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e28d3fc_14ed_442e_be78_9930417a5fa8.slice/crio-d5060e547e041672e4ab9d8c950dec6a67b17fd32dc5858c03bef17d470a8a95 WatchSource:0}: Error finding container d5060e547e041672e4ab9d8c950dec6a67b17fd32dc5858c03bef17d470a8a95: Status 404 returned error can't find the container with id d5060e547e041672e4ab9d8c950dec6a67b17fd32dc5858c03bef17d470a8a95 Jun 12 20:09:44.544726 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.544546 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 20:04:43 +0000 UTC" deadline="2028-01-10 05:28:13.783030536 +0000 UTC" Jun 12 20:09:44.545061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.544730 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13833h18m29.238323409s" Jun 12 20:09:44.577967 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.577940 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" event={"ID":"3de76128908ab97fc26daab2e5570029","Type":"ContainerStarted","Data":"a0b72e103eabc523832e1bc337deb87a2c6fb20e00bf602d2eb4f6ebf3f98042"} Jun 12 20:09:44.579193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.579167 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" event={"ID":"25b3b276-4d53-47d7-a416-179d75cac87d","Type":"ContainerStarted","Data":"fc19df6ae761a4e766041976e9b55a72de34072a908d25924af0b280b4ce8739"} Jun 12 20:09:44.580268 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.580244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffk9h" event={"ID":"e8d200bc-f584-417e-9d47-826ad9507d62","Type":"ContainerStarted","Data":"5be6c2ca47d06a6b9ac10b34564cdd4026274dbaeafa22798b89aad4b53cd08e"} Jun 12 20:09:44.581256 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.581233 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8p5x" event={"ID":"cbc778f6-80ac-4480-bc10-55479741f6ba","Type":"ContainerStarted","Data":"e9691554b716522cc0c01c9dd4ca1c8a6eef3945a3a241c83c1d9c8b30d047ae"} Jun 12 20:09:44.582289 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.582271 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerStarted","Data":"71b0c7c42ec854b2de59831546714f6a8a63c812ebcb7599a61603c9c448a4e9"} Jun 12 20:09:44.583316 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.583290 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hr8l9" event={"ID":"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c","Type":"ContainerStarted","Data":"c9b321646d2616216460787807846006a2afffe898d8a44dc14c6e060b5099f3"} Jun 12 20:09:44.584320 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.584302 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hznww" event={"ID":"0e28d3fc-14ed-442e-be78-9930417a5fa8","Type":"ContainerStarted","Data":"d5060e547e041672e4ab9d8c950dec6a67b17fd32dc5858c03bef17d470a8a95"} Jun 12 20:09:44.585205 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.585187 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" event={"ID":"8c934d81-4ca7-453b-8b5e-0801a3745b71","Type":"ContainerStarted","Data":"1d74fc4e09e07b8e1a97564f746fd7df9a3015131885b52ccc9b480e06dd9cb0"} Jun 12 20:09:44.586335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.586244 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fz282" event={"ID":"51b62985-38de-42e2-8d2a-4f786ef66027","Type":"ContainerStarted","Data":"1ea7d1bd6109d27a32c02a7e06389f4939ef7213501a98c7815e14682b20c4f1"} Jun 12 20:09:44.587493 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.587463 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"324063077ae2367d9a9f9fcb831875337e49d6f0cb01bf31cb160569c270315e"} Jun 12 20:09:44.599657 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:44.599621 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-137-64.ec2.internal" podStartSLOduration=2.599609446 podStartE2EDuration="2.599609446s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:44.599504675 +0000 UTC m=+3.469929922" watchObservedRunningTime="2026-06-12 20:09:44.599609446 +0000 UTC m=+3.470034725" Jun 12 20:09:45.226411 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.226378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:45.226578 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.226459 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:45.226637 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.226582 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:45.226686 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.226656 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.226634902 +0000 UTC m=+6.097060137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:45.227239 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.227093 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:45.227239 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.227143 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.227128345 +0000 UTC m=+6.097553573 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:45.327385 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.327348 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:45.327552 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.327519 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:45.327552 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.327541 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:45.327552 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.327554 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:45.327710 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.327606 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:47.327589432 +0000 UTC m=+6.198014666 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:45.545228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.545159 2579 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 20:04:43 +0000 UTC" deadline="2028-01-25 15:00:53.231634409 +0000 UTC" Jun 12 20:09:45.545228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.545226 2579 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14202h51m7.686413013s" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.570960 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.571078 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.571461 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.571559 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.571624 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:45.571747 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:45.571702 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:45.598448 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.598410 2579 generic.go:356] "Generic (PLEG): container finished" podID="476954021ee69e62ad4fe91157fd7a93" containerID="082fe75c935399805866e6860d795c87679882fc4bd8dcf7985b856344156865" exitCode=0 Jun 12 20:09:45.599141 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:45.598837 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" event={"ID":"476954021ee69e62ad4fe91157fd7a93","Type":"ContainerDied","Data":"082fe75c935399805866e6860d795c87679882fc4bd8dcf7985b856344156865"} Jun 12 20:09:46.620665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:46.620623 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" event={"ID":"476954021ee69e62ad4fe91157fd7a93","Type":"ContainerStarted","Data":"2349f240b5e77a56b58050f28a742d4fbc70a09f1a0d6d27ab0d07fbfbe977eb"} Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.248568 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.248652 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.248824 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.248887 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:51.248869106 +0000 UTC m=+10.119294353 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.249430 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:47.249526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.249482 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:51.249465937 +0000 UTC m=+10.119891177 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:47.349898 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.349848 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:47.350070 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.350008 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:47.350070 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.350025 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:47.350070 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.350037 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:47.350225 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.350102 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:51.350082738 +0000 UTC m=+10.220507961 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:47.569810 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.569560 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:47.569810 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.569602 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:47.569810 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.569705 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:47.569810 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:47.569805 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:47.570108 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.569961 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:47.570108 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:47.570054 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:49.568913 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:49.568923 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:49.569054 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:49.569077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:49.569186 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:49.569451 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:49.569296 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:51.280504 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.280471 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:51.281072 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.280542 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:51.281072 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.280622 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:51.281072 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.280645 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:51.281072 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.280699 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:59.280683884 +0000 UTC m=+18.151109122 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:51.281072 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.280714 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:59.280707662 +0000 UTC m=+18.151132886 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:51.381382 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.381327 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:51.381536 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.381489 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:51.381536 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.381515 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:51.381536 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.381527 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:51.381691 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.381592 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:09:59.381573729 +0000 UTC m=+18.251998991 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:51.569821 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.569717 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:51.569966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.569853 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:51.569966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:51.569874 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:51.569966 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.569950 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:51.570129 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.569950 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:51.570129 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:51.570014 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:53.569106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:53.569075 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:53.569106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:53.569095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:53.569648 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:53.569077 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:53.569648 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:53.569205 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:53.569648 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:53.569273 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:53.569648 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:53.569340 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:55.569281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:55.569244 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:55.569733 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:55.569253 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:55.569733 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:55.569384 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:55.569733 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:55.569459 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:55.569733 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:55.569520 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:55.569733 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:55.569607 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:57.568919 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:57.568886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:57.568919 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:57.568911 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:57.569376 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:57.568886 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:57.569376 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:57.568996 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:57.569376 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:57.569056 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:57.569376 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:57.569136 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:58.646059 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.645846 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" event={"ID":"25b3b276-4d53-47d7-a416-179d75cac87d","Type":"ContainerStarted","Data":"fd2fd894778527a3ec6c724e28b42966eb6fc4ae800ee5a5592efcf86bb2c011"} Jun 12 20:09:58.647456 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.647424 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-ffk9h" event={"ID":"e8d200bc-f584-417e-9d47-826ad9507d62","Type":"ContainerStarted","Data":"2b7584b4290716486455cb2f0e3ab715400439fb88110a5bad12796ab8e9fa9a"} Jun 12 20:09:58.648942 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.648915 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-q8p5x" event={"ID":"cbc778f6-80ac-4480-bc10-55479741f6ba","Type":"ContainerStarted","Data":"df033b7550c4b128b4ba6bf4c3bad7ee8586b785c1a17d588c4cb89a2e1730e3"} Jun 12 20:09:58.650553 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.650530 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="f07e5ac9596c213b95ea0b20b8c843c577844e0a69aca4c3d22ec8c4a21c46bf" exitCode=0 Jun 12 20:09:58.650651 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.650614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"f07e5ac9596c213b95ea0b20b8c843c577844e0a69aca4c3d22ec8c4a21c46bf"} Jun 12 20:09:58.652257 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.652229 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-hr8l9" event={"ID":"fcb516fc-dd07-4a2e-ab29-a307e7ed5c1c","Type":"ContainerStarted","Data":"15712d4ae79087b450ae79fe8d6c6aff14840b2bdd127f38079485e46e5c9777"} Jun 12 20:09:58.653755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.653733 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-hznww" event={"ID":"0e28d3fc-14ed-442e-be78-9930417a5fa8","Type":"ContainerStarted","Data":"2cc2e346dcd8f67a9cb13266c1f57c8439b15e8d92c156e383ccf1e11c29141f"} Jun 12 20:09:58.655170 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.655149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" event={"ID":"8c934d81-4ca7-453b-8b5e-0801a3745b71","Type":"ContainerStarted","Data":"5ad1b8976c93e0958d0cd44921d276261f353427dba711685b85242b75b0a339"} Jun 12 20:09:58.663777 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.663733 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-q9fsz" podStartSLOduration=4.385467566 podStartE2EDuration="17.66371809s" totalImagesPullingTime="13.278250524s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.663542108 +0000 UTC m=+17.533967355" watchObservedRunningTime="2026-06-12 20:09:58.66371809 +0000 UTC m=+17.534143336" Jun 12 20:09:58.663922 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.663897 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-137-64.ec2.internal" podStartSLOduration=16.663887292 podStartE2EDuration="16.663887292s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:46.636029194 +0000 UTC m=+5.506454441" watchObservedRunningTime="2026-06-12 20:09:58.663887292 +0000 UTC m=+17.534312540" Jun 12 20:09:58.677120 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.677083 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-q8p5x" podStartSLOduration=4.417348802 podStartE2EDuration="17.677067823s" totalImagesPullingTime="13.259719021s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.676239781 +0000 UTC m=+17.546665026" watchObservedRunningTime="2026-06-12 20:09:58.677067823 +0000 UTC m=+17.547493071" Jun 12 20:09:58.711510 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.711452 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-hr8l9" podStartSLOduration=4.3824929919999995 podStartE2EDuration="17.71143625s" totalImagesPullingTime="13.328943258s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.710956607 +0000 UTC m=+17.581381868" watchObservedRunningTime="2026-06-12 20:09:58.71143625 +0000 UTC m=+17.581861495" Jun 12 20:09:58.724344 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.724297 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-ffk9h" podStartSLOduration=4.465022558 podStartE2EDuration="17.724283001s" totalImagesPullingTime="13.259260443s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.724200064 +0000 UTC m=+17.594625310" watchObservedRunningTime="2026-06-12 20:09:58.724283001 +0000 UTC m=+17.594708243" Jun 12 20:09:58.738347 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:58.738302 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-hznww" podStartSLOduration=8.294933601 podStartE2EDuration="17.738285183s" totalImagesPullingTime="9.443351582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:58.737848908 +0000 UTC m=+17.608274154" watchObservedRunningTime="2026-06-12 20:09:58.738285183 +0000 UTC m=+17.608710430" Jun 12 20:09:59.084877 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.084856 2579 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 20:09:59.342280 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.342211 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:59.342446 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.342301 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:59.342446 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.342325 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:59.342446 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.342387 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:59.342446 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.342399 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:15.342377793 +0000 UTC m=+34.212803036 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:09:59.342446 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.342421 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:15.342410865 +0000 UTC m=+34.212836102 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:09:59.443197 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.443158 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:59.443382 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.443300 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:09:59.443382 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.443326 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:09:59.443382 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.443340 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:59.443609 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.443400 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:15.44338369 +0000 UTC m=+34.313808934 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:09:59.564649 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.564539 2579 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T20:09:59.084873249Z","UUID":"b33142ed-b4a0-4d13-b460-118c4f8e3898","Handler":null,"Name":"","Endpoint":""} Jun 12 20:09:59.566598 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.566576 2579 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 20:09:59.566867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.566617 2579 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 20:09:59.569426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.569132 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:09:59.571722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.569614 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:09:59.571722 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.569728 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:09:59.571722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.570083 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:09:59.571722 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.570159 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:09:59.572418 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:09:59.572257 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:09:59.660979 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.660891 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" event={"ID":"8c934d81-4ca7-453b-8b5e-0801a3745b71","Type":"ContainerStarted","Data":"a43aa6f2686ec079063493219a401911dc53eda5b65d2c984e952d55e0dd5663"} Jun 12 20:09:59.663165 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:09:59.663057 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-fz282" event={"ID":"51b62985-38de-42e2-8d2a-4f786ef66027","Type":"ContainerStarted","Data":"900754f991cdd39f363cc3593913f5679d52aa52d1516dde1e2b7d5290a03b18"} Jun 12 20:10:00.668120 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:00.667862 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" event={"ID":"8c934d81-4ca7-453b-8b5e-0801a3745b71","Type":"ContainerStarted","Data":"d5cf72a08d323c214effe183ae3f83b4946b6a61d7371bea92e9e20985466b18"} Jun 12 20:10:00.687955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:00.687902 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zj84t" podStartSLOduration=4.129425405 podStartE2EDuration="19.687883236s" totalImagesPullingTime="15.558457831s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:00.687692886 +0000 UTC m=+19.558118153" watchObservedRunningTime="2026-06-12 20:10:00.687883236 +0000 UTC m=+19.558308482" Jun 12 20:10:00.688228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:00.688197 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-fz282" podStartSLOduration=6.422925405 podStartE2EDuration="19.688188571s" totalImagesPullingTime="13.265263166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:09:59.67772529 +0000 UTC m=+18.548150564" watchObservedRunningTime="2026-06-12 20:10:00.688188571 +0000 UTC m=+19.558613819" Jun 12 20:10:01.570241 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:01.570208 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:01.570415 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:01.570308 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:01.570415 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:01.570366 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:01.570528 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:01.570465 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:01.570528 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:01.570524 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:01.570638 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:01.570602 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:03.011393 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:03.011350 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:10:03.012119 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:03.012099 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:10:03.569651 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:03.569618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:03.569651 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:03.569646 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:03.569906 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:03.569618 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:03.569906 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:03.569735 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:03.569906 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:03.569840 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:03.570077 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:03.569931 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:04.271172 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:04.271135 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:10:04.271734 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:04.271710 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-hznww" Jun 12 20:10:05.569556 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:05.569522 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:05.570102 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:05.569523 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:05.570102 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:05.569645 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:05.570102 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:05.569653 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:05.570102 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:05.569752 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:05.570102 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:05.569848 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:07.569350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:07.569323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:07.569835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:07.569323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:07.569835 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:07.569425 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:07.569835 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:07.569543 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:07.569835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:07.569323 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:07.569835 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:07.569667 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:07.682935 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:07.682910 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="53f7fa5cd0dc60e0770fd60958ffa7b814c71ee58bdd72aa6e3104343e541bdf" exitCode=0 Jun 12 20:10:07.683022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:07.682960 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"53f7fa5cd0dc60e0770fd60958ffa7b814c71ee58bdd72aa6e3104343e541bdf"} Jun 12 20:10:08.687870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.687696 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688139 2579 generic.go:356] "Generic (PLEG): container finished" podID="8518d8a7-4f34-4b98-af15-e5cc5d2f32b4" containerID="4bf092c332083aececab484cc7ab2409b4936491bf83d632a076a86af29ab7a8" exitCode=1 Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688176 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"13649f76dff52026e1d2f436677c908d52707c651c4d29394b0c5ac3212adef6"} Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688249 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"d694d410a1aabaa964c9a1f9bcf2d276faf2fecd85c2d4c8ba865801ff702d8a"} Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688280 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"8973bdebd4608f39e075272066dafe6611af0ba415aa35712151e1ab7e046bdf"} Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688307 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"427e74881634a9667f12349955016b22a0ce6a0498e096aa2f0ff83011e6d9e0"} Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688334 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerDied","Data":"4bf092c332083aececab484cc7ab2409b4936491bf83d632a076a86af29ab7a8"} Jun 12 20:10:08.688426 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:08.688360 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"a5bcfc1495ca9c5999ae8e8f98ab079449da4a9128efc37fce38707aae142a92"} Jun 12 20:10:09.568724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:09.568695 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:09.568724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:09.568707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:09.568724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:09.568707 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:09.569041 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:09.568788 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:09.569041 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:09.568898 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:09.569041 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:09.569003 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:09.692215 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:09.692187 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="1fa0bf497883b23488be595de8418b1c594718e74d297efad0ac8bb1bea9085d" exitCode=0 Jun 12 20:10:09.692569 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:09.692228 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"1fa0bf497883b23488be595de8418b1c594718e74d297efad0ac8bb1bea9085d"} Jun 12 20:10:10.697474 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:10.697408 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:10:10.697811 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:10.697696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"9f53a6211cec8b3840b4a0c3c74f5491615e5e259f7c01a4c70f4ba2a879ee7f"} Jun 12 20:10:11.569720 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:11.569688 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:11.569909 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:11.569814 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:11.569909 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:11.569838 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:11.569909 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:11.569883 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:11.570069 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:11.569968 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:11.570069 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:11.570036 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:11.702121 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:11.702093 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="99f3cdc3e456f68e3833ab567d1f29233aaef9e333c2c2c67c606d35c0e967ad" exitCode=0 Jun 12 20:10:11.702490 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:11.702126 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"99f3cdc3e456f68e3833ab567d1f29233aaef9e333c2c2c67c606d35c0e967ad"} Jun 12 20:10:12.708358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.708083 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:10:12.708828 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.708717 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"132499c96ec428a517b53694a5a554361b0ecdab006cce07ebde13a38bd20a54"} Jun 12 20:10:12.709027 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.709000 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:12.709160 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.709072 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:12.709216 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.709207 2579 scope.go:117] "RemoveContainer" containerID="4bf092c332083aececab484cc7ab2409b4936491bf83d632a076a86af29ab7a8" Jun 12 20:10:12.729137 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:12.729116 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:13.569344 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.569309 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:13.569512 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.569308 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:13.569512 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:13.569457 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:13.569759 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:13.569731 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:13.569930 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.569869 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:13.570057 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:13.569974 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:13.715612 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.715581 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:10:13.716041 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.716016 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" event={"ID":"8518d8a7-4f34-4b98-af15-e5cc5d2f32b4","Type":"ContainerStarted","Data":"72bac55e4c72ce11eb41691c7cababac8b41f9024cd54eaa2de04012cf5c2855"} Jun 12 20:10:13.716459 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.716374 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:13.731653 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.731632 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:13.748520 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:13.748483 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" podStartSLOduration=9.518892949 podStartE2EDuration="32.748468085s" totalImagesPullingTime="23.229575136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:13.747014244 +0000 UTC m=+32.617439507" watchObservedRunningTime="2026-06-12 20:10:13.748468085 +0000 UTC m=+32.618893329" Jun 12 20:10:14.444431 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.442703 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qzv8j"] Jun 12 20:10:14.444431 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.442959 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:14.444431 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:14.443216 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:14.446633 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.446606 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gldlc"] Jun 12 20:10:14.446756 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.446727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:14.446946 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:14.446922 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:14.447225 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.447202 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-229hn"] Jun 12 20:10:14.447314 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:14.447297 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:14.447404 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:14.447386 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:15.373808 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:15.373759 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:15.374348 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:15.373855 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:15.374348 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.373896 2579 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 20:10:15.374348 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.373945 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:10:15.374348 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.373959 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret podName:6af625a6-463a-466a-b491-6461e57cfde9 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:47.373939925 +0000 UTC m=+66.244365165 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret") pod "global-pull-secret-syncer-qzv8j" (UID: "6af625a6-463a-466a-b491-6461e57cfde9") : object "kube-system"/"original-pull-secret" not registered Jun 12 20:10:15.374348 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.373978 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:47.373967481 +0000 UTC m=+66.244392719 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 20:10:15.474287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:15.474253 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:15.474480 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.474409 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 20:10:15.474480 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.474427 2579 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 20:10:15.474480 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.474436 2579 projected.go:196] Error preparing data for projected volume kube-api-access-jcfr8 for pod openshift-network-diagnostics/network-check-target-229hn: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:10:15.474642 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.474489 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8 podName:2ad5b6c0-aeae-4767-9855-1f4d916fb336 nodeName:}" failed. No retries permitted until 2026-06-12 20:10:47.474470761 +0000 UTC m=+66.344895987 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-jcfr8" (UniqueName: "kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8") pod "network-check-target-229hn" (UID: "2ad5b6c0-aeae-4767-9855-1f4d916fb336") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 20:10:15.569219 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:15.569186 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:15.569392 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:15.569202 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:15.569392 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.569311 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:15.569496 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:15.569408 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:16.568984 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:16.568814 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:16.569300 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:16.569050 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:16.724757 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:16.724691 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="974d0f91b312fd0a5a49e52954b8842f3a6564e1ef0d4d997e904ebd5b4a6ddf" exitCode=0 Jun 12 20:10:16.724757 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:16.724732 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"974d0f91b312fd0a5a49e52954b8842f3a6564e1ef0d4d997e904ebd5b4a6ddf"} Jun 12 20:10:17.568884 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:17.568854 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:17.569065 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:17.568855 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:17.569065 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:17.568978 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:17.569065 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:17.569049 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:17.729611 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:17.729582 2579 generic.go:356] "Generic (PLEG): container finished" podID="caa22a41-9a32-4717-ba35-febd79e79a15" containerID="33c43216f172ac2fc0db035499b960c9a3b01755c81c34aed0653bc4c49d0514" exitCode=0 Jun 12 20:10:17.729611 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:17.729611 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerDied","Data":"33c43216f172ac2fc0db035499b960c9a3b01755c81c34aed0653bc4c49d0514"} Jun 12 20:10:18.569470 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:18.569440 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:18.569935 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:18.569526 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qzv8j" podUID="6af625a6-463a-466a-b491-6461e57cfde9" Jun 12 20:10:18.734783 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:18.734755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" event={"ID":"caa22a41-9a32-4717-ba35-febd79e79a15","Type":"ContainerStarted","Data":"acf2f34b0c4c9efaba88f544e89e0845a772017c45fbc50658d2789f54fa63be"} Jun 12 20:10:18.761772 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:18.761731 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mcwpv" podStartSLOduration=9.533878135 podStartE2EDuration="37.761717814s" totalImagesPullingTime="28.227839679s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:18.761487813 +0000 UTC m=+37.631913061" watchObservedRunningTime="2026-06-12 20:10:18.761717814 +0000 UTC m=+37.632143059" Jun 12 20:10:19.569420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:19.569388 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:19.569577 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:19.569512 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-229hn" podUID="2ad5b6c0-aeae-4767-9855-1f4d916fb336" Jun 12 20:10:19.569577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:19.569562 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:19.569914 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:19.569652 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:10:20.439561 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.439530 2579 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-137-64.ec2.internal" event="NodeReady" Jun 12 20:10:20.439665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.439628 2579 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 20:10:20.484665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.484636 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-mvs42"] Jun 12 20:10:20.503606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.503579 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-cgsxb"] Jun 12 20:10:20.503729 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.503712 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.506418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.506356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 20:10:20.506418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.506360 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxkq\"" Jun 12 20:10:20.506575 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.506411 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 20:10:20.512178 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.512163 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.512240 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.512184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhpv8\" (UniqueName: \"kubernetes.io/projected/70eee006-4f8c-4aa6-9e12-084be5161b3e-kube-api-access-dhpv8\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.512240 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.512211 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70eee006-4f8c-4aa6-9e12-084be5161b3e-tmp-dir\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.512313 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.512285 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70eee006-4f8c-4aa6-9e12-084be5161b3e-config-volume\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.527482 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.527463 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvs42"] Jun 12 20:10:20.527566 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.527492 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgsxb"] Jun 12 20:10:20.527604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.527564 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.529969 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.529949 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 20:10:20.530147 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.530097 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 20:10:20.530147 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.530097 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-hjr59\"" Jun 12 20:10:20.530240 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.530119 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 20:10:20.569278 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.569258 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:20.572028 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.572011 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 20:10:20.613463 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613442 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.613540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613472 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhpv8\" (UniqueName: \"kubernetes.io/projected/70eee006-4f8c-4aa6-9e12-084be5161b3e-kube-api-access-dhpv8\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.613540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c61ef41a-e865-48c9-8500-f06b2359daac-cert\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.613540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613521 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70eee006-4f8c-4aa6-9e12-084be5161b3e-tmp-dir\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.613665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tz2z6\" (UniqueName: \"kubernetes.io/projected/c61ef41a-e865-48c9-8500-f06b2359daac-kube-api-access-tz2z6\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.613665 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:20.613566 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:20.613665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613584 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70eee006-4f8c-4aa6-9e12-084be5161b3e-config-volume\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.613665 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:20.613614 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:21.11360073 +0000 UTC m=+39.984025959 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:20.613835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.613820 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70eee006-4f8c-4aa6-9e12-084be5161b3e-tmp-dir\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.614077 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.614062 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/70eee006-4f8c-4aa6-9e12-084be5161b3e-config-volume\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.626741 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.626710 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhpv8\" (UniqueName: \"kubernetes.io/projected/70eee006-4f8c-4aa6-9e12-084be5161b3e-kube-api-access-dhpv8\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:20.714108 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.714086 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c61ef41a-e865-48c9-8500-f06b2359daac-cert\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.714174 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.714122 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tz2z6\" (UniqueName: \"kubernetes.io/projected/c61ef41a-e865-48c9-8500-f06b2359daac-kube-api-access-tz2z6\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.716200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.716175 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/c61ef41a-e865-48c9-8500-f06b2359daac-cert\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.722052 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.722034 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tz2z6\" (UniqueName: \"kubernetes.io/projected/c61ef41a-e865-48c9-8500-f06b2359daac-kube-api-access-tz2z6\") pod \"ingress-canary-cgsxb\" (UID: \"c61ef41a-e865-48c9-8500-f06b2359daac\") " pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.812530 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.812478 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8"] Jun 12 20:10:20.835930 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.835910 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-cgsxb" Jun 12 20:10:20.847568 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.847549 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8"] Jun 12 20:10:20.847654 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.847574 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s"] Jun 12 20:10:20.847697 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.847662 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:20.850014 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.849995 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 20:10:20.850125 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.850108 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-qvw9k\"" Jun 12 20:10:20.850207 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.850190 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 20:10:20.850732 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.850710 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 20:10:20.850831 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.850722 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 20:10:20.861041 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.861024 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s"] Jun 12 20:10:20.861119 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.861095 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:20.863606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.863591 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 12 20:10:20.915920 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.915896 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8fa019-e1b9-4e45-8efb-9a479165bc41-tmp\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:20.916024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.915954 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qwjs2\" (UniqueName: \"kubernetes.io/projected/fd8fa019-e1b9-4e45-8efb-9a479165bc41-kube-api-access-qwjs2\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:20.916024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.915973 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-plbqk\" (UniqueName: \"kubernetes.io/projected/b7270edd-828a-4c5f-8770-07d168f4e47f-kube-api-access-plbqk\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:20.916090 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.916040 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd8fa019-e1b9-4e45-8efb-9a479165bc41-klusterlet-config\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:20.916090 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:20.916055 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7270edd-828a-4c5f-8770-07d168f4e47f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.016599 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016426 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8fa019-e1b9-4e45-8efb-9a479165bc41-tmp\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.016697 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016645 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qwjs2\" (UniqueName: \"kubernetes.io/projected/fd8fa019-e1b9-4e45-8efb-9a479165bc41-kube-api-access-qwjs2\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.016697 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016662 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-plbqk\" (UniqueName: \"kubernetes.io/projected/b7270edd-828a-4c5f-8770-07d168f4e47f-kube-api-access-plbqk\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.016832 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016725 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd8fa019-e1b9-4e45-8efb-9a479165bc41-klusterlet-config\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.016832 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7270edd-828a-4c5f-8770-07d168f4e47f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.016832 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.016822 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fd8fa019-e1b9-4e45-8efb-9a479165bc41-tmp\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.019548 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.019527 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/b7270edd-828a-4c5f-8770-07d168f4e47f-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.019679 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.019661 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/fd8fa019-e1b9-4e45-8efb-9a479165bc41-klusterlet-config\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.025532 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.025508 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qwjs2\" (UniqueName: \"kubernetes.io/projected/fd8fa019-e1b9-4e45-8efb-9a479165bc41-kube-api-access-qwjs2\") pod \"klusterlet-addon-workmgr-6858bdfb74-2qw5s\" (UID: \"fd8fa019-e1b9-4e45-8efb-9a479165bc41\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.025655 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.025636 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-plbqk\" (UniqueName: \"kubernetes.io/projected/b7270edd-828a-4c5f-8770-07d168f4e47f-kube-api-access-plbqk\") pod \"managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8\" (UID: \"b7270edd-828a-4c5f-8770-07d168f4e47f\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.051414 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.051389 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-cgsxb"] Jun 12 20:10:21.054813 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:10:21.054781 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc61ef41a_e865_48c9_8500_f06b2359daac.slice/crio-41dedf5212833e02a00c4ce4e7e712cbbf325aea1253d0e6b6be265ce0115e85 WatchSource:0}: Error finding container 41dedf5212833e02a00c4ce4e7e712cbbf325aea1253d0e6b6be265ce0115e85: Status 404 returned error can't find the container with id 41dedf5212833e02a00c4ce4e7e712cbbf325aea1253d0e6b6be265ce0115e85 Jun 12 20:10:21.117931 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.117872 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:21.118016 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:21.117999 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:21.118070 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:21.118061 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:22.11804618 +0000 UTC m=+40.988471407 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:21.168211 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.168191 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:10:21.179437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.179415 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:21.327632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.327604 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8"] Jun 12 20:10:21.331378 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:10:21.331350 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb7270edd_828a_4c5f_8770_07d168f4e47f.slice/crio-42e0ea32c61265189d0c4c684ec0e65de4f1fa0f2e8a7ad4b34ac393cda9fe11 WatchSource:0}: Error finding container 42e0ea32c61265189d0c4c684ec0e65de4f1fa0f2e8a7ad4b34ac393cda9fe11: Status 404 returned error can't find the container with id 42e0ea32c61265189d0c4c684ec0e65de4f1fa0f2e8a7ad4b34ac393cda9fe11 Jun 12 20:10:21.342355 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.341063 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s"] Jun 12 20:10:21.354917 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:10:21.354895 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd8fa019_e1b9_4e45_8efb_9a479165bc41.slice/crio-f04c766273a1429de8ee4d77fba1acae1703f8e979574a5587addda18df9b804 WatchSource:0}: Error finding container f04c766273a1429de8ee4d77fba1acae1703f8e979574a5587addda18df9b804: Status 404 returned error can't find the container with id f04c766273a1429de8ee4d77fba1acae1703f8e979574a5587addda18df9b804 Jun 12 20:10:21.572342 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.572318 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:21.572857 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.572328 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:21.575228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.575165 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nl7nn\"" Jun 12 20:10:21.575228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.575186 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 20:10:21.575228 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.575194 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 20:10:21.575433 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.575348 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 20:10:21.575919 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.575900 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gl8lm\"" Jun 12 20:10:21.743541 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.743501 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerStarted","Data":"f04c766273a1429de8ee4d77fba1acae1703f8e979574a5587addda18df9b804"} Jun 12 20:10:21.744640 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.744610 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgsxb" event={"ID":"c61ef41a-e865-48c9-8500-f06b2359daac","Type":"ContainerStarted","Data":"41dedf5212833e02a00c4ce4e7e712cbbf325aea1253d0e6b6be265ce0115e85"} Jun 12 20:10:21.745821 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:21.745782 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerStarted","Data":"42e0ea32c61265189d0c4c684ec0e65de4f1fa0f2e8a7ad4b34ac393cda9fe11"} Jun 12 20:10:22.125272 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:22.125224 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:22.125435 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:22.125371 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:22.125521 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:22.125447 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:24.125431502 +0000 UTC m=+42.995856729 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:24.141475 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:24.141377 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:24.141884 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:24.141568 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:24.141884 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:24.141657 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:28.141636122 +0000 UTC m=+47.012061360 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:24.756022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:24.755814 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-cgsxb" event={"ID":"c61ef41a-e865-48c9-8500-f06b2359daac","Type":"ContainerStarted","Data":"a056d01d659bf7616ce69c7a19ec9ff70a0eb12c2e8f148cc7f46ed50f278281"} Jun 12 20:10:24.781347 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:24.781256 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-cgsxb" podStartSLOduration=1.308240431 podStartE2EDuration="4.781237981s" totalImagesPullingTime="3.47299755s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:24.781092676 +0000 UTC m=+43.651517924" watchObservedRunningTime="2026-06-12 20:10:24.781237981 +0000 UTC m=+43.651663227" Jun 12 20:10:27.764096 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.764059 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerStarted","Data":"9708eaf4006c911d63a42c5da866d52f50a151dac03630e92e5c6aeec689d39a"} Jun 12 20:10:27.765444 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.765419 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerStarted","Data":"44d080acdffd095182f52f4f06bf12170953589a4349f64990ace2171279f6eb"} Jun 12 20:10:27.765634 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.765618 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:27.767013 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.766992 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:10:27.782678 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.782633 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" podStartSLOduration=2.144479543 podStartE2EDuration="7.782617531s" totalImagesPullingTime="5.638137988s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:27.781466116 +0000 UTC m=+46.651891351" watchObservedRunningTime="2026-06-12 20:10:27.782617531 +0000 UTC m=+46.653042777" Jun 12 20:10:27.795734 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:27.795699 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" podStartSLOduration=1.74556017 podStartE2EDuration="7.79568673s" totalImagesPullingTime="6.05012656s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:27.795137626 +0000 UTC m=+46.665562890" watchObservedRunningTime="2026-06-12 20:10:27.79568673 +0000 UTC m=+46.666111974" Jun 12 20:10:28.169841 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:28.169774 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:28.169957 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:28.169908 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:28.169998 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:28.169963 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:36.169948856 +0000 UTC m=+55.040374079 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:36.222352 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:36.222307 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:36.223030 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:36.222442 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:36.223030 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:36.222517 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:10:52.222500867 +0000 UTC m=+71.092926090 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:45.730970 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:45.730936 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-scr5q" Jun 12 20:10:47.394061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.394028 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:47.394455 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.394088 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:10:47.396839 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.396816 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 20:10:47.396940 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.396825 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 20:10:47.404979 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:47.404960 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 20:10:47.405046 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:47.405017 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:11:51.405003276 +0000 UTC m=+130.275428502 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : secret "metrics-daemon-secret" not found Jun 12 20:10:47.408291 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.408260 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/6af625a6-463a-466a-b491-6461e57cfde9-original-pull-secret\") pod \"global-pull-secret-syncer-qzv8j\" (UID: \"6af625a6-463a-466a-b491-6461e57cfde9\") " pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:47.495288 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.495262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:47.498047 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.498032 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 20:10:47.508062 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.508041 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 20:10:47.519219 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.519198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcfr8\" (UniqueName: \"kubernetes.io/projected/2ad5b6c0-aeae-4767-9855-1f4d916fb336-kube-api-access-jcfr8\") pod \"network-check-target-229hn\" (UID: \"2ad5b6c0-aeae-4767-9855-1f4d916fb336\") " pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:47.577140 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.577119 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qzv8j" Jun 12 20:10:47.686381 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.686356 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nl7nn\"" Jun 12 20:10:47.693479 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.693455 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qzv8j"] Jun 12 20:10:47.694590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.694570 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:47.697027 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:10:47.697004 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af625a6_463a_466a_b491_6461e57cfde9.slice/crio-f51fe6aa520ac951be93146457b5910a177630008c99d1c12fd3bf3933eb1547 WatchSource:0}: Error finding container f51fe6aa520ac951be93146457b5910a177630008c99d1c12fd3bf3933eb1547: Status 404 returned error can't find the container with id f51fe6aa520ac951be93146457b5910a177630008c99d1c12fd3bf3933eb1547 Jun 12 20:10:47.811338 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.811311 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-229hn"] Jun 12 20:10:47.813743 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:47.813705 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qzv8j" event={"ID":"6af625a6-463a-466a-b491-6461e57cfde9","Type":"ContainerStarted","Data":"f51fe6aa520ac951be93146457b5910a177630008c99d1c12fd3bf3933eb1547"} Jun 12 20:10:47.814247 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:10:47.814227 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2ad5b6c0_aeae_4767_9855_1f4d916fb336.slice/crio-75fb48eedb5f49f58f9783ec871c762ba1d39ce342755d5bea9deaace75be4f5 WatchSource:0}: Error finding container 75fb48eedb5f49f58f9783ec871c762ba1d39ce342755d5bea9deaace75be4f5: Status 404 returned error can't find the container with id 75fb48eedb5f49f58f9783ec871c762ba1d39ce342755d5bea9deaace75be4f5 Jun 12 20:10:48.818823 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:48.818764 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-229hn" event={"ID":"2ad5b6c0-aeae-4767-9855-1f4d916fb336","Type":"ContainerStarted","Data":"75fb48eedb5f49f58f9783ec871c762ba1d39ce342755d5bea9deaace75be4f5"} Jun 12 20:10:52.228537 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.228448 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:10:52.228893 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:52.228602 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:10:52.228893 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:10:52.228677 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:11:24.228661929 +0000 UTC m=+103.099087153 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:10:52.831495 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.831447 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qzv8j" event={"ID":"6af625a6-463a-466a-b491-6461e57cfde9","Type":"ContainerStarted","Data":"60e64c6a8c689e3fbfd17d038eb39ad6b7e81d2fdf1538d994f3838e28e30ac8"} Jun 12 20:10:52.832941 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.832906 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-229hn" event={"ID":"2ad5b6c0-aeae-4767-9855-1f4d916fb336","Type":"ContainerStarted","Data":"f6a7b404f23cf79d5d79678cc211da4e0074c66436fb1ad27beec558ce45fa8b"} Jun 12 20:10:52.833066 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.833050 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:10:52.845936 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.845891 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qzv8j" podStartSLOduration=67.566042766 podStartE2EDuration="1m11.845875931s" totalImagesPullingTime="4.279833165s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:52.845719408 +0000 UTC m=+71.716144654" watchObservedRunningTime="2026-06-12 20:10:52.845875931 +0000 UTC m=+71.716301177" Jun 12 20:10:52.859475 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:10:52.859425 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-229hn" podStartSLOduration=67.698575822 podStartE2EDuration="1m11.859413381s" totalImagesPullingTime="4.160837559s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:10:52.859065209 +0000 UTC m=+71.729490453" watchObservedRunningTime="2026-06-12 20:10:52.859413381 +0000 UTC m=+71.729838626" Jun 12 20:11:23.841610 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:11:23.841579 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-229hn" Jun 12 20:11:24.240032 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:11:24.240001 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:11:24.240187 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:11:24.240130 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:11:24.240187 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:11:24.240182 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:12:28.240168717 +0000 UTC m=+167.110593953 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:11:51.417705 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:11:51.417670 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:11:51.418163 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:11:51.417808 2579 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 20:11:51.418163 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:11:51.417872 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs podName:f3d69e07-ed28-422e-9944-4f3e0481a327 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:53.417857855 +0000 UTC m=+252.288283077 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs") pod "network-metrics-daemon-gldlc" (UID: "f3d69e07-ed28-422e-9944-4f3e0481a327") : secret "metrics-daemon-secret" not found Jun 12 20:12:23.512849 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:23.512767 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mvs42" podUID="70eee006-4f8c-4aa6-9e12-084be5161b3e" Jun 12 20:12:24.094810 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:24.094772 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvs42" Jun 12 20:12:24.589735 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:24.589691 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-gldlc" podUID="f3d69e07-ed28-422e-9944-4f3e0481a327" Jun 12 20:12:27.766891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:27.766847 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" podUID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" containerName="acm-agent" probeResult="failure" output="Get \"http://10.134.0.9:8000/readyz\": dial tcp 10.134.0.9:8000: connect: connection refused" Jun 12 20:12:28.108225 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.108194 2579 generic.go:356] "Generic (PLEG): container finished" podID="b7270edd-828a-4c5f-8770-07d168f4e47f" containerID="9708eaf4006c911d63a42c5da866d52f50a151dac03630e92e5c6aeec689d39a" exitCode=255 Jun 12 20:12:28.108379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.108267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerDied","Data":"9708eaf4006c911d63a42c5da866d52f50a151dac03630e92e5c6aeec689d39a"} Jun 12 20:12:28.109921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.109897 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" containerID="44d080acdffd095182f52f4f06bf12170953589a4349f64990ace2171279f6eb" exitCode=1 Jun 12 20:12:28.110051 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.109946 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerDied","Data":"44d080acdffd095182f52f4f06bf12170953589a4349f64990ace2171279f6eb"} Jun 12 20:12:28.110250 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.110233 2579 scope.go:117] "RemoveContainer" containerID="44d080acdffd095182f52f4f06bf12170953589a4349f64990ace2171279f6eb" Jun 12 20:12:28.115078 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.115057 2579 scope.go:117] "RemoveContainer" containerID="9708eaf4006c911d63a42c5da866d52f50a151dac03630e92e5c6aeec689d39a" Jun 12 20:12:28.262169 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:28.262136 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:12:28.262339 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:28.262273 2579 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 20:12:28.262339 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:28.262333 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls podName:70eee006-4f8c-4aa6-9e12-084be5161b3e nodeName:}" failed. No retries permitted until 2026-06-12 20:14:30.262316851 +0000 UTC m=+289.132742080 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls") pod "dns-default-mvs42" (UID: "70eee006-4f8c-4aa6-9e12-084be5161b3e") : secret "dns-default-metrics-tls" not found Jun 12 20:12:29.114472 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:29.114430 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerStarted","Data":"968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0"} Jun 12 20:12:29.116177 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:29.116149 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerStarted","Data":"5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7"} Jun 12 20:12:29.116424 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:29.116404 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:12:29.116985 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:29.116967 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:12:35.569408 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:35.569368 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:12:55.633163 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.633129 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:12:55.635043 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.635019 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.638171 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.638147 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 20:12:55.639428 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.639400 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 20:12:55.639533 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.639425 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 20:12:55.640091 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.640071 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-5mqvq\"" Jun 12 20:12:55.651396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.651366 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 20:12:55.664998 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.664976 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:12:55.729370 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.729346 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl"] Jun 12 20:12:55.730942 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.730929 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.733279 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.733259 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:12:55.733373 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.733287 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jun 12 20:12:55.733373 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.733357 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jun 12 20:12:55.733626 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.733611 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jun 12 20:12:55.735985 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.735968 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-slwpz\"" Jun 12 20:12:55.738466 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738441 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738546 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738479 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-69hl5\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738546 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738510 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738620 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738571 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738620 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738594 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738649 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738701 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.738755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.738740 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.747087 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.747068 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl"] Jun 12 20:12:55.839682 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839657 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.839816 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839685 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-69hl5\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.839816 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839706 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.839937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839846 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.839937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839879 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.839937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839902 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2f63188-3019-4729-b8a8-1775c069cda1-config\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.839937 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.839923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j82g7\" (UniqueName: \"kubernetes.io/projected/b2f63188-3019-4729-b8a8-1775c069cda1-kube-api-access-j82g7\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:55.839980 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:55.839996 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cc4757b8b-5s22d: secret "image-registry-tls" not found Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840009 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840036 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f63188-3019-4729-b8a8-1775c069cda1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:55.840058 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls podName:2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e nodeName:}" failed. No retries permitted until 2026-06-12 20:12:56.340040569 +0000 UTC m=+195.210465797 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls") pod "image-registry-6cc4757b8b-5s22d" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e") : secret "image-registry-tls" not found Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840097 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.840133 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840128 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.840475 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840450 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.840529 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840470 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.840685 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.840662 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.842136 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.842118 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.842387 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.842370 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.859127 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.859102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.859448 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.859427 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-69hl5\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:55.940640 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.940590 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2f63188-3019-4729-b8a8-1775c069cda1-config\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.940640 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.940619 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j82g7\" (UniqueName: \"kubernetes.io/projected/b2f63188-3019-4729-b8a8-1775c069cda1-kube-api-access-j82g7\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.940750 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.940656 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f63188-3019-4729-b8a8-1775c069cda1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.941189 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.941168 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b2f63188-3019-4729-b8a8-1775c069cda1-config\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.942493 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.942469 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b2f63188-3019-4729-b8a8-1775c069cda1-serving-cert\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:55.951220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:55.951200 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-j82g7\" (UniqueName: \"kubernetes.io/projected/b2f63188-3019-4729-b8a8-1775c069cda1-kube-api-access-j82g7\") pod \"service-ca-operator-7ccbfd59dc-8m4hl\" (UID: \"b2f63188-3019-4729-b8a8-1775c069cda1\") " pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:56.039560 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:56.039521 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" Jun 12 20:12:56.166811 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:56.166770 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl"] Jun 12 20:12:56.169665 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:12:56.169642 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2f63188_3019_4729_b8a8_1775c069cda1.slice/crio-1e9dd19131d89a020ec668361accf2680fd2102b14cfb309630e3d61755e62fa WatchSource:0}: Error finding container 1e9dd19131d89a020ec668361accf2680fd2102b14cfb309630e3d61755e62fa: Status 404 returned error can't find the container with id 1e9dd19131d89a020ec668361accf2680fd2102b14cfb309630e3d61755e62fa Jun 12 20:12:56.194773 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:56.194713 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" event={"ID":"b2f63188-3019-4729-b8a8-1775c069cda1","Type":"ContainerStarted","Data":"1e9dd19131d89a020ec668361accf2680fd2102b14cfb309630e3d61755e62fa"} Jun 12 20:12:56.343758 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:56.343734 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:56.343917 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:56.343898 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:12:56.343966 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:56.343919 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cc4757b8b-5s22d: secret "image-registry-tls" not found Jun 12 20:12:56.344000 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:56.343972 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls podName:2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e nodeName:}" failed. No retries permitted until 2026-06-12 20:12:57.343955572 +0000 UTC m=+196.214380833 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls") pod "image-registry-6cc4757b8b-5s22d" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e") : secret "image-registry-tls" not found Jun 12 20:12:57.351961 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:57.351915 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:57.352329 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:57.352056 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:12:57.352329 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:57.352076 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cc4757b8b-5s22d: secret "image-registry-tls" not found Jun 12 20:12:57.352329 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:57.352125 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls podName:2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e nodeName:}" failed. No retries permitted until 2026-06-12 20:12:59.352110995 +0000 UTC m=+198.222536233 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls") pod "image-registry-6cc4757b8b-5s22d" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e") : secret "image-registry-tls" not found Jun 12 20:12:59.205972 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.205942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" event={"ID":"b2f63188-3019-4729-b8a8-1775c069cda1","Type":"ContainerStarted","Data":"f70032d2d7fae7f52ea49065a493d0d124b57135ca61cdc2f0ec6047ec3e74cf"} Jun 12 20:12:59.222365 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.222326 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" podStartSLOduration=1.26378381 podStartE2EDuration="4.222310778s" totalImagesPullingTime="2.958526968s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:12:59.222288893 +0000 UTC m=+198.092714143" watchObservedRunningTime="2026-06-12 20:12:59.222310778 +0000 UTC m=+198.092736013" Jun 12 20:12:59.366741 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.366715 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:12:59.366877 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.366817 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:12:59.366877 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.366828 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cc4757b8b-5s22d: secret "image-registry-tls" not found Jun 12 20:12:59.366877 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.366879 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls podName:2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.366866179 +0000 UTC m=+202.237291402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls") pod "image-registry-6cc4757b8b-5s22d" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e") : secret "image-registry-tls" not found Jun 12 20:12:59.399686 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.399622 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-4hzsk"] Jun 12 20:12:59.401460 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.401442 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.403914 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.403891 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 20:12:59.404022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.403993 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 20:12:59.404491 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.404478 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 20:12:59.404946 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.404933 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 20:12:59.405028 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.404964 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8fjk8\"" Jun 12 20:12:59.418496 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.418473 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4hzsk"] Jun 12 20:12:59.467986 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.467963 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.468075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.467991 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49068369-b4b7-486e-ac52-2a8f42b487d4-crio-socket\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.468118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.468062 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.468118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.468108 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5gs6v\" (UniqueName: \"kubernetes.io/projected/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-api-access-5gs6v\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.468189 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.468165 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49068369-b4b7-486e-ac52-2a8f42b487d4-data-volume\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568570 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568577 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49068369-b4b7-486e-ac52-2a8f42b487d4-crio-socket\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568612 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568680 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.568651 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:12:59.568867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568681 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/49068369-b4b7-486e-ac52-2a8f42b487d4-crio-socket\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568867 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.568723 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:12:59.568867 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.568726 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:00.068706281 +0000 UTC m=+198.939131523 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : configmap "kube-rbac-proxy" not found Jun 12 20:12:59.568867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568779 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5gs6v\" (UniqueName: \"kubernetes.io/projected/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-api-access-5gs6v\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.568867 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:12:59.568841 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:00.068824374 +0000 UTC m=+198.939249603 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:12:59.569071 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.568951 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49068369-b4b7-486e-ac52-2a8f42b487d4-data-volume\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.569238 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.569222 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/49068369-b4b7-486e-ac52-2a8f42b487d4-data-volume\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:12:59.578287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:12:59.578259 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5gs6v\" (UniqueName: \"kubernetes.io/projected/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-api-access-5gs6v\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:00.076370 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.076333 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:00.076526 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.076393 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:00.076526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:00.076457 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:00.076526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:00.076498 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:00.076526 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:00.076524 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:01.076505132 +0000 UTC m=+199.946930356 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : configmap "kube-rbac-proxy" not found Jun 12 20:13:00.076661 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:00.076547 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:01.076531544 +0000 UTC m=+199.946956771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:00.710829 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.710784 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4"] Jun 12 20:13:00.712597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.712582 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" Jun 12 20:13:00.714896 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.714877 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 20:13:00.716449 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.716433 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 20:13:00.716553 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.716458 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-l54mc\"" Jun 12 20:13:00.721615 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.721593 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4"] Jun 12 20:13:00.781459 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.781425 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b5llp\" (UniqueName: \"kubernetes.io/projected/a8baab42-7319-43f4-a6d0-84e5a11d8a03-kube-api-access-b5llp\") pod \"migrator-d4bcd4867-55lm4\" (UID: \"a8baab42-7319-43f4-a6d0-84e5a11d8a03\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" Jun 12 20:13:00.882584 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.882551 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b5llp\" (UniqueName: \"kubernetes.io/projected/a8baab42-7319-43f4-a6d0-84e5a11d8a03-kube-api-access-b5llp\") pod \"migrator-d4bcd4867-55lm4\" (UID: \"a8baab42-7319-43f4-a6d0-84e5a11d8a03\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" Jun 12 20:13:00.893420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:00.893392 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b5llp\" (UniqueName: \"kubernetes.io/projected/a8baab42-7319-43f4-a6d0-84e5a11d8a03-kube-api-access-b5llp\") pod \"migrator-d4bcd4867-55lm4\" (UID: \"a8baab42-7319-43f4-a6d0-84e5a11d8a03\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" Jun 12 20:13:01.022061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.022042 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" Jun 12 20:13:01.084349 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.084323 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:01.084485 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.084382 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:01.084485 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:01.084433 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:01.084583 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:01.084514 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.084493548 +0000 UTC m=+201.954918792 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : configmap "kube-rbac-proxy" not found Jun 12 20:13:01.084583 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:01.084562 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:01.084666 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:01.084629 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:03.084595882 +0000 UTC m=+201.955021125 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:01.142535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.142513 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4"] Jun 12 20:13:01.144846 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:01.144820 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda8baab42_7319_43f4_a6d0_84e5a11d8a03.slice/crio-78f409c9aa55d439ec5390c22a6f42d7c032687599bffa744a6322e1615d26e8 WatchSource:0}: Error finding container 78f409c9aa55d439ec5390c22a6f42d7c032687599bffa744a6322e1615d26e8: Status 404 returned error can't find the container with id 78f409c9aa55d439ec5390c22a6f42d7c032687599bffa744a6322e1615d26e8 Jun 12 20:13:01.212141 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.212115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" event={"ID":"a8baab42-7319-43f4-a6d0-84e5a11d8a03","Type":"ContainerStarted","Data":"78f409c9aa55d439ec5390c22a6f42d7c032687599bffa744a6322e1615d26e8"} Jun 12 20:13:01.368499 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:01.368449 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffk9h_e8d200bc-f584-417e-9d47-826ad9507d62/dns-node-resolver/0.log" Jun 12 20:13:02.569192 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:02.569167 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8p5x_cbc778f6-80ac-4480-bc10-55479741f6ba/node-ca/0.log" Jun 12 20:13:03.097946 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.097916 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:03.098125 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.097956 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:03.098125 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.098041 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:03.098125 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.098064 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:03.098125 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.098108 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:07.098090348 +0000 UTC m=+205.968515576 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : configmap "kube-rbac-proxy" not found Jun 12 20:13:03.098125 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.098123 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:07.09811731 +0000 UTC m=+205.968542533 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:03.166868 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.166845 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgsxb_c61ef41a-e865-48c9-8500-f06b2359daac/serve-healthcheck-canary/0.log" Jun 12 20:13:03.221238 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.221207 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" event={"ID":"a8baab42-7319-43f4-a6d0-84e5a11d8a03","Type":"ContainerStarted","Data":"a2d5d5e9a2a722bfb3fec26670cf9ca079d9f82003f4a9f178e47ea226610de9"} Jun 12 20:13:03.221345 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.221255 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" event={"ID":"a8baab42-7319-43f4-a6d0-84e5a11d8a03","Type":"ContainerStarted","Data":"22ee49bfe91876e190dae21f9f6067f5a09a85f7b7b26f9628f8c5bf7310d34c"} Jun 12 20:13:03.237003 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.236965 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-55lm4" podStartSLOduration=2.03386574 podStartE2EDuration="3.236949989s" totalImagesPullingTime="1.203084249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:03.235884611 +0000 UTC m=+202.106309869" watchObservedRunningTime="2026-06-12 20:13:03.236949989 +0000 UTC m=+202.107375234" Jun 12 20:13:03.400091 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:03.400031 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:03.400186 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.400168 2579 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 20:13:03.400223 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.400188 2579 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-6cc4757b8b-5s22d: secret "image-registry-tls" not found Jun 12 20:13:03.400254 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:03.400240 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls podName:2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e nodeName:}" failed. No retries permitted until 2026-06-12 20:13:11.400222764 +0000 UTC m=+210.270648001 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls") pod "image-registry-6cc4757b8b-5s22d" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e") : secret "image-registry-tls" not found Jun 12 20:13:07.127151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:07.127110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:07.127151 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:07.127157 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:07.127628 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:07.127229 2579 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 20:13:07.127628 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:07.127250 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:07.127628 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:07.127294 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:15.127278255 +0000 UTC m=+213.997703481 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : configmap "kube-rbac-proxy" not found Jun 12 20:13:07.127628 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:07.127311 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:15.127303743 +0000 UTC m=+213.997728966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:11.457538 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:11.457498 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:11.460232 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:11.460201 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"image-registry-6cc4757b8b-5s22d\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:11.543979 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:11.543953 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:11.673407 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:11.673376 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:13:11.676734 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:11.676708 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b4c1fc5_cf8b_4164_bc05_ac5c81694d5e.slice/crio-5ac305364569a258f315517afa95b0caf31e628bfd00b685530cd9c82a9bb658 WatchSource:0}: Error finding container 5ac305364569a258f315517afa95b0caf31e628bfd00b685530cd9c82a9bb658: Status 404 returned error can't find the container with id 5ac305364569a258f315517afa95b0caf31e628bfd00b685530cd9c82a9bb658 Jun 12 20:13:12.248333 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:12.248294 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" event={"ID":"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e","Type":"ContainerStarted","Data":"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d"} Jun 12 20:13:12.248484 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:12.248382 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" event={"ID":"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e","Type":"ContainerStarted","Data":"5ac305364569a258f315517afa95b0caf31e628bfd00b685530cd9c82a9bb658"} Jun 12 20:13:12.248484 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:12.248446 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:12.268007 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:12.267962 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" podStartSLOduration=17.267948932 podStartE2EDuration="17.267948932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:12:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:12.267421794 +0000 UTC m=+211.137847036" watchObservedRunningTime="2026-06-12 20:13:12.267948932 +0000 UTC m=+211.138374155" Jun 12 20:13:15.181661 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:15.181630 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:15.182038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:15.181672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:15.182038 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:15.181780 2579 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 20:13:15.182038 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:15.181859 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls podName:49068369-b4b7-486e-ac52-2a8f42b487d4 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:31.181845108 +0000 UTC m=+230.052270331 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls") pod "insights-runtime-extractor-4hzsk" (UID: "49068369-b4b7-486e-ac52-2a8f42b487d4") : secret "insights-runtime-extractor-tls" not found Jun 12 20:13:15.182183 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:15.182163 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/49068369-b4b7-486e-ac52-2a8f42b487d4-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:21.591730 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:21.591698 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:13:31.199814 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.199770 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:31.202227 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.202198 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/49068369-b4b7-486e-ac52-2a8f42b487d4-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-4hzsk\" (UID: \"49068369-b4b7-486e-ac52-2a8f42b487d4\") " pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:31.210138 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.210115 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-4hzsk" Jun 12 20:13:31.336186 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.336155 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-4hzsk"] Jun 12 20:13:31.338932 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:31.338909 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49068369_b4b7_486e_ac52_2a8f42b487d4.slice/crio-c49fea4214955ad6312e127ccb855886d1958fbc7afdd64b11c7388bad153f22 WatchSource:0}: Error finding container c49fea4214955ad6312e127ccb855886d1958fbc7afdd64b11c7388bad153f22: Status 404 returned error can't find the container with id c49fea4214955ad6312e127ccb855886d1958fbc7afdd64b11c7388bad153f22 Jun 12 20:13:31.596543 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.596509 2579 patch_prober.go:28] interesting pod/image-registry-6cc4757b8b-5s22d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 20:13:31.596672 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:31.596569 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 20:13:32.310002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:32.309958 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4hzsk" event={"ID":"49068369-b4b7-486e-ac52-2a8f42b487d4","Type":"ContainerStarted","Data":"c49fea4214955ad6312e127ccb855886d1958fbc7afdd64b11c7388bad153f22"} Jun 12 20:13:35.321925 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:35.321882 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4hzsk" event={"ID":"49068369-b4b7-486e-ac52-2a8f42b487d4","Type":"ContainerStarted","Data":"0281259f38824ff0b63e9e119297640bd3d81b1ffe211e978570691e8fd6eaf6"} Jun 12 20:13:36.328470 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.328432 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4hzsk" event={"ID":"49068369-b4b7-486e-ac52-2a8f42b487d4","Type":"ContainerStarted","Data":"e829529dfa359f37c7370be03c32d1421148130c80e5cae7497b46f6c3bae35a"} Jun 12 20:13:36.452480 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.452444 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:13:36.455502 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.455481 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.458285 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.458256 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jun 12 20:13:36.459415 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459391 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jun 12 20:13:36.459542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459461 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jun 12 20:13:36.459542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459484 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jun 12 20:13:36.459682 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459507 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jun 12 20:13:36.459754 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459686 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jun 12 20:13:36.459754 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.459749 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7k6g6\"" Jun 12 20:13:36.460109 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.460090 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jun 12 20:13:36.469343 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.469321 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:13:36.540094 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540068 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.540196 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540096 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.540196 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.540196 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540140 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.540303 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540231 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.540303 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.540261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qtwzn\" (UniqueName: \"kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641130 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qtwzn\" (UniqueName: \"kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641167 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641183 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641204 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641325 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.641956 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641933 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.642052 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.641969 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.642281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.642262 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.643845 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.643816 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.643941 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.643826 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.649267 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.649245 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qtwzn\" (UniqueName: \"kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn\") pod \"console-7f98569f95-h9vsm\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:36.767082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:36.767052 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:37.285417 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:37.285393 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:13:37.287340 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:37.287315 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc13379b1_c7a1_4b27_ae66_c28f218b917f.slice/crio-0eb13ce69de0aced0c6842b35e52da7493e5ffc23ca234ea363bc280a7671d4f WatchSource:0}: Error finding container 0eb13ce69de0aced0c6842b35e52da7493e5ffc23ca234ea363bc280a7671d4f: Status 404 returned error can't find the container with id 0eb13ce69de0aced0c6842b35e52da7493e5ffc23ca234ea363bc280a7671d4f Jun 12 20:13:37.332789 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:37.332759 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-4hzsk" event={"ID":"49068369-b4b7-486e-ac52-2a8f42b487d4","Type":"ContainerStarted","Data":"f54c9b28ddca2f7dcf3b5def9571203a2f7111aed3589f346205344b765a01b1"} Jun 12 20:13:37.333883 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:37.333865 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98569f95-h9vsm" event={"ID":"c13379b1-c7a1-4b27-ae66-c28f218b917f","Type":"ContainerStarted","Data":"0eb13ce69de0aced0c6842b35e52da7493e5ffc23ca234ea363bc280a7671d4f"} Jun 12 20:13:37.351068 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:37.351021 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-4hzsk" podStartSLOduration=32.583977802 podStartE2EDuration="38.351007417s" totalImagesPullingTime="5.767029615s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:12:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:37.350632063 +0000 UTC m=+236.221057309" watchObservedRunningTime="2026-06-12 20:13:37.351007417 +0000 UTC m=+236.221432664" Jun 12 20:13:41.350153 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:41.350066 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98569f95-h9vsm" event={"ID":"c13379b1-c7a1-4b27-ae66-c28f218b917f","Type":"ContainerStarted","Data":"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25"} Jun 12 20:13:41.368710 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:41.368660 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7f98569f95-h9vsm" podStartSLOduration=1.611924654 podStartE2EDuration="5.36864654s" totalImagesPullingTime="3.756721886s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:41.367550177 +0000 UTC m=+240.237975423" watchObservedRunningTime="2026-06-12 20:13:41.36864654 +0000 UTC m=+240.239071784" Jun 12 20:13:41.596977 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:41.596942 2579 patch_prober.go:28] interesting pod/image-registry-6cc4757b8b-5s22d container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 20:13:41.597131 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:41.596995 2579 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 20:13:42.788115 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.788082 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:13:42.791237 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.791220 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.810735 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.810711 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jun 12 20:13:42.811410 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.811388 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:13:42.884756 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884731 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.884897 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884781 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.884897 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.884897 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884876 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.885061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884923 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dsnmz\" (UniqueName: \"kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.885061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.885061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.884996 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.985971 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.985949 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.985978 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986010 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dsnmz\" (UniqueName: \"kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986045 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986069 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986392 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986147 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.986924 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986896 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.987025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986920 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.987025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986933 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.987025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.986951 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.988636 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.988604 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.988729 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.988613 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:42.993994 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:42.993973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dsnmz\" (UniqueName: \"kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz\") pod \"console-c675f64bf-tkcxn\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:43.100118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:43.100044 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:43.220910 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:43.220873 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:13:43.223223 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:43.223197 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7c86e524_c3e9_4b21_8451_d9ff1d24318d.slice/crio-647d9ae24c121dfe9a96656bb0b342be7f7a87a84b418787ddf901393407debe WatchSource:0}: Error finding container 647d9ae24c121dfe9a96656bb0b342be7f7a87a84b418787ddf901393407debe: Status 404 returned error can't find the container with id 647d9ae24c121dfe9a96656bb0b342be7f7a87a84b418787ddf901393407debe Jun 12 20:13:43.357722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:43.357651 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c675f64bf-tkcxn" event={"ID":"7c86e524-c3e9-4b21-8451-d9ff1d24318d","Type":"ContainerStarted","Data":"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473"} Jun 12 20:13:43.357722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:43.357696 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c675f64bf-tkcxn" event={"ID":"7c86e524-c3e9-4b21-8451-d9ff1d24318d","Type":"ContainerStarted","Data":"647d9ae24c121dfe9a96656bb0b342be7f7a87a84b418787ddf901393407debe"} Jun 12 20:13:43.375273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:43.375224 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c675f64bf-tkcxn" podStartSLOduration=1.375210182 podStartE2EDuration="1.375210182s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:43.374075077 +0000 UTC m=+242.244500322" watchObservedRunningTime="2026-06-12 20:13:43.375210182 +0000 UTC m=+242.245635426" Jun 12 20:13:46.611805 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.611756 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" containerID="cri-o://bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d" gracePeriod=30 Jun 12 20:13:46.767604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.767556 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:46.767752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.767636 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:13:46.768944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.768919 2579 patch_prober.go:28] interesting pod/console-7f98569f95-h9vsm container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" start-of-body= Jun 12 20:13:46.769030 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.768960 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-7f98569f95-h9vsm" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerName="console" probeResult="failure" output="Get \"https://10.134.0.14:8443/health\": dial tcp 10.134.0.14:8443: connect: connection refused" Jun 12 20:13:46.853379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:46.853358 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:47.017629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017606 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-69hl5\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017740 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017636 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017740 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017657 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017740 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017684 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017740 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017725 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017918 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017753 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017918 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017775 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.017918 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.017817 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets\") pod \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\" (UID: \"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e\") " Jun 12 20:13:47.018242 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.018186 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:13:47.018369 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.018341 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:13:47.020158 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.020126 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:13:47.020269 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.020133 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5" (OuterVolumeSpecName: "kube-api-access-69hl5") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "kube-api-access-69hl5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:13:47.020330 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.020279 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:13:47.020429 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.020341 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:13:47.020429 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.020359 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:13:47.027085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.027060 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" (UID: "2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:13:47.118726 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118701 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-69hl5\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-kube-api-access-69hl5\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118726 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118721 2579 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-tls\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118726 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118730 2579 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-registry-certificates\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118913 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118739 2579 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-ca-trust-extracted\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118913 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118747 2579 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-image-registry-private-configuration\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118913 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118756 2579 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-bound-sa-token\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118913 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118765 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-trusted-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.118913 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.118773 2579 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e-installation-pull-secrets\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:13:47.374220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.374140 2579 generic.go:356] "Generic (PLEG): container finished" podID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerID="bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d" exitCode=0 Jun 12 20:13:47.374220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.374184 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" event={"ID":"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e","Type":"ContainerDied","Data":"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d"} Jun 12 20:13:47.374527 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.374217 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" Jun 12 20:13:47.374527 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.374253 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-6cc4757b8b-5s22d" event={"ID":"2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e","Type":"ContainerDied","Data":"5ac305364569a258f315517afa95b0caf31e628bfd00b685530cd9c82a9bb658"} Jun 12 20:13:47.374527 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.374277 2579 scope.go:117] "RemoveContainer" containerID="bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d" Jun 12 20:13:47.384045 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.384027 2579 scope.go:117] "RemoveContainer" containerID="bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d" Jun 12 20:13:47.384338 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:47.384315 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d\": container with ID starting with bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d not found: ID does not exist" containerID="bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d" Jun 12 20:13:47.384398 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.384346 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d"} err="failed to get container status \"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d\": rpc error: code = NotFound desc = could not find container \"bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d\": container with ID starting with bfd2b11ccdd503518843db668739de64a389816cb48916177339839ec15cf60d not found: ID does not exist" Jun 12 20:13:47.413286 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.413263 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:13:47.422367 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.422344 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-6cc4757b8b-5s22d"] Jun 12 20:13:47.572896 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:47.572874 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" path="/var/lib/kubelet/pods/2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e/volumes" Jun 12 20:13:48.240835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.240753 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm"] Jun 12 20:13:48.241202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.241018 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" Jun 12 20:13:48.241202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.241035 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" Jun 12 20:13:48.241202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.241097 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b4c1fc5-cf8b-4164-bc05-ac5c81694d5e" containerName="registry" Jun 12 20:13:48.245904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.245884 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.248158 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.248140 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 20:13:48.248266 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.248244 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 20:13:48.248463 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.248443 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 20:13:48.249461 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.249446 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-8fbwt\"" Jun 12 20:13:48.249542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.249464 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 20:13:48.249542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.249471 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 20:13:48.261413 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.261396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm"] Jun 12 20:13:48.280364 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.280345 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-fpczf"] Jun 12 20:13:48.283305 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.283290 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw"] Jun 12 20:13:48.283438 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.283421 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.286205 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.286184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.286529 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.286508 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-47zqg\"" Jun 12 20:13:48.286606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.286542 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 20:13:48.286606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.286512 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 20:13:48.286606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.286514 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 20:13:48.289982 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.289964 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-njvvb\"" Jun 12 20:13:48.290118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.290075 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jun 12 20:13:48.290334 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.290301 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jun 12 20:13:48.290510 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.290497 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jun 12 20:13:48.303983 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.303966 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw"] Jun 12 20:13:48.428384 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428355 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-wtmp\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428384 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428382 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-metrics-client-ca\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428401 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428419 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428436 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3191cde6-814c-4e21-ac3f-b9cdc2469465-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428478 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9n9fd\" (UniqueName: \"kubernetes.io/projected/90dc2fa2-9321-4401-a7d6-65c8ffb30959-kube-api-access-9n9fd\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428493 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jgsvp\" (UniqueName: \"kubernetes.io/projected/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-api-access-jgsvp\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.428535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428512 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-sys\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428544 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428593 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-root\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428611 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-textfile\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5bfdb0ca-9143-44d4-86f0-37490a1d202f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428714 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fcrk4\" (UniqueName: \"kubernetes.io/projected/3191cde6-814c-4e21-ac3f-b9cdc2469465-kube-api-access-fcrk4\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.428752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428747 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.429082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.429082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428784 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.429082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.428856 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.530757 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9n9fd\" (UniqueName: \"kubernetes.io/projected/90dc2fa2-9321-4401-a7d6-65c8ffb30959-kube-api-access-9n9fd\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.530880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jgsvp\" (UniqueName: \"kubernetes.io/projected/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-api-access-jgsvp\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.530914 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-sys\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.530975 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531032 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-root\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531065 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-textfile\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531110 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5bfdb0ca-9143-44d4-86f0-37490a1d202f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531163 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531229 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fcrk4\" (UniqueName: \"kubernetes.io/projected/3191cde6-814c-4e21-ac3f-b9cdc2469465-kube-api-access-fcrk4\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531381 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531414 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531456 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531514 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-wtmp\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531549 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-metrics-client-ca\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.534437 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531582 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531615 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531643 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.531672 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3191cde6-814c-4e21-ac3f-b9cdc2469465-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.532467 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3191cde6-814c-4e21-ac3f-b9cdc2469465-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.533065 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-sys\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:48.533162 2579 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:48.533222 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls podName:90dc2fa2-9321-4401-a7d6-65c8ffb30959 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:49.033205576 +0000 UTC m=+247.903630801 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls") pod "node-exporter-fpczf" (UID: "90dc2fa2-9321-4401-a7d6-65c8ffb30959") : secret "node-exporter-tls" not found Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.533430 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-root\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.533719 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-textfile\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.534027 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/5bfdb0ca-9143-44d4-86f0-37490a1d202f-volume-directive-shadow\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.534344 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-wtmp\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:48.534354 2579 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:48.534449 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls podName:3191cde6-814c-4e21-ac3f-b9cdc2469465 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:49.03442599 +0000 UTC m=+247.904851222 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-bwzdm" (UID: "3191cde6-814c-4e21-ac3f-b9cdc2469465") : secret "openshift-state-metrics-tls" not found Jun 12 20:13:48.535106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.534722 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-metrics-client-ca\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.536835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.535752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-metrics-client-ca\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.536835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.535871 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-accelerators-collector-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.536835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.535930 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.537049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.536986 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.537105 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.537045 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.537849 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.537825 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-state-metrics-tls\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.537931 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.537893 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.540830 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.540811 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9n9fd\" (UniqueName: \"kubernetes.io/projected/90dc2fa2-9321-4401-a7d6-65c8ffb30959-kube-api-access-9n9fd\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:48.541250 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.541230 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jgsvp\" (UniqueName: \"kubernetes.io/projected/5bfdb0ca-9143-44d4-86f0-37490a1d202f-kube-api-access-jgsvp\") pod \"kube-state-metrics-678bc549d7-5jmqw\" (UID: \"5bfdb0ca-9143-44d4-86f0-37490a1d202f\") " pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.542332 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.542314 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fcrk4\" (UniqueName: \"kubernetes.io/projected/3191cde6-814c-4e21-ac3f-b9cdc2469465-kube-api-access-fcrk4\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:48.597721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.597687 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" Jun 12 20:13:48.737407 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:48.737384 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw"] Jun 12 20:13:48.739662 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:48.739633 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5bfdb0ca_9143_44d4_86f0_37490a1d202f.slice/crio-4013ec11c4847a204716d17eecfc6ff9d70f9da0a08b9470a2fb70de799a05cc WatchSource:0}: Error finding container 4013ec11c4847a204716d17eecfc6ff9d70f9da0a08b9470a2fb70de799a05cc: Status 404 returned error can't find the container with id 4013ec11c4847a204716d17eecfc6ff9d70f9da0a08b9470a2fb70de799a05cc Jun 12 20:13:49.039396 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.039367 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:49.039582 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.039446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:49.041590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.041562 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/90dc2fa2-9321-4401-a7d6-65c8ffb30959-node-exporter-tls\") pod \"node-exporter-fpczf\" (UID: \"90dc2fa2-9321-4401-a7d6-65c8ffb30959\") " pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:49.041694 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.041676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/3191cde6-814c-4e21-ac3f-b9cdc2469465-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-bwzdm\" (UID: \"3191cde6-814c-4e21-ac3f-b9cdc2469465\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:49.155316 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.155293 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" Jun 12 20:13:49.193277 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.193243 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-fpczf" Jun 12 20:13:49.210684 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:49.210660 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod90dc2fa2_9321_4401_a7d6_65c8ffb30959.slice/crio-f498e7b2f011b7aeccda1b97a6870be1c02f385ee59cd910dc0c0cf984d75cf5 WatchSource:0}: Error finding container f498e7b2f011b7aeccda1b97a6870be1c02f385ee59cd910dc0c0cf984d75cf5: Status 404 returned error can't find the container with id f498e7b2f011b7aeccda1b97a6870be1c02f385ee59cd910dc0c0cf984d75cf5 Jun 12 20:13:49.283643 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.283617 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm"] Jun 12 20:13:49.286598 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:49.286574 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3191cde6_814c_4e21_ac3f_b9cdc2469465.slice/crio-052461d24c7c047a7cd2c52f34fb285006e3c159070a2a4cbcc1a04cde9b7d4a WatchSource:0}: Error finding container 052461d24c7c047a7cd2c52f34fb285006e3c159070a2a4cbcc1a04cde9b7d4a: Status 404 returned error can't find the container with id 052461d24c7c047a7cd2c52f34fb285006e3c159070a2a4cbcc1a04cde9b7d4a Jun 12 20:13:49.383635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.383605 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpczf" event={"ID":"90dc2fa2-9321-4401-a7d6-65c8ffb30959","Type":"ContainerStarted","Data":"f498e7b2f011b7aeccda1b97a6870be1c02f385ee59cd910dc0c0cf984d75cf5"} Jun 12 20:13:49.385548 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.385519 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" event={"ID":"3191cde6-814c-4e21-ac3f-b9cdc2469465","Type":"ContainerStarted","Data":"664ffcf8af7737faf32fbc5d3214cc2d5824a3184f9466a6c971e556642ae9d3"} Jun 12 20:13:49.385649 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.385582 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" event={"ID":"3191cde6-814c-4e21-ac3f-b9cdc2469465","Type":"ContainerStarted","Data":"052461d24c7c047a7cd2c52f34fb285006e3c159070a2a4cbcc1a04cde9b7d4a"} Jun 12 20:13:49.387929 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:49.387899 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" event={"ID":"5bfdb0ca-9143-44d4-86f0-37490a1d202f","Type":"ContainerStarted","Data":"4013ec11c4847a204716d17eecfc6ff9d70f9da0a08b9470a2fb70de799a05cc"} Jun 12 20:13:50.395375 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:50.395339 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" event={"ID":"3191cde6-814c-4e21-ac3f-b9cdc2469465","Type":"ContainerStarted","Data":"9131a93294268a62fde068a3ff59ec7aaad53434d4f0df7f86317c7596dd371f"} Jun 12 20:13:51.400401 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.400370 2579 generic.go:356] "Generic (PLEG): container finished" podID="90dc2fa2-9321-4401-a7d6-65c8ffb30959" containerID="caeeae6d7cdfa31b53e9861f76531ee7220f00066c023adceb424c9d417ebaab" exitCode=0 Jun 12 20:13:51.400847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.400456 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpczf" event={"ID":"90dc2fa2-9321-4401-a7d6-65c8ffb30959","Type":"ContainerDied","Data":"caeeae6d7cdfa31b53e9861f76531ee7220f00066c023adceb424c9d417ebaab"} Jun 12 20:13:51.402603 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.402580 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" event={"ID":"3191cde6-814c-4e21-ac3f-b9cdc2469465","Type":"ContainerStarted","Data":"64886ce81e03237eb168e17e11d01c1fe8de44a87771512c47b7e5474e2e9aa1"} Jun 12 20:13:51.404660 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.404636 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" event={"ID":"5bfdb0ca-9143-44d4-86f0-37490a1d202f","Type":"ContainerStarted","Data":"bd6d014898e6ca5af89c5452ee0e8f813203f656f26df1d49b8b329bb71e34bc"} Jun 12 20:13:51.404762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.404683 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" event={"ID":"5bfdb0ca-9143-44d4-86f0-37490a1d202f","Type":"ContainerStarted","Data":"18201ffae92015b49d52a647160a2a61f8f5f990d0c908525b0420aba04c648b"} Jun 12 20:13:51.404762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.404712 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" event={"ID":"5bfdb0ca-9143-44d4-86f0-37490a1d202f","Type":"ContainerStarted","Data":"80234082ae396cb4fa6e622634f62e3a44a7413f9c7da99a22ac9718178bfd69"} Jun 12 20:13:51.438331 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.438289 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-bwzdm" podStartSLOduration=2.157704429 podStartE2EDuration="3.438275801s" totalImagesPullingTime="1.280571372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:51.436724296 +0000 UTC m=+250.307149542" watchObservedRunningTime="2026-06-12 20:13:51.438275801 +0000 UTC m=+250.308701024" Jun 12 20:13:51.455388 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:51.455341 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-678bc549d7-5jmqw" podStartSLOduration=1.492660436 podStartE2EDuration="3.455322588s" totalImagesPullingTime="1.962662152s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:51.454998854 +0000 UTC m=+250.325424132" watchObservedRunningTime="2026-06-12 20:13:51.455322588 +0000 UTC m=+250.325747832" Jun 12 20:13:52.412717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:52.412675 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpczf" event={"ID":"90dc2fa2-9321-4401-a7d6-65c8ffb30959","Type":"ContainerStarted","Data":"5fb4a1d70a84a7f3140293329057f2b0a19e8d04a517dced3ee2c4ac1c95a14b"} Jun 12 20:13:52.413135 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:52.412743 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-fpczf" event={"ID":"90dc2fa2-9321-4401-a7d6-65c8ffb30959","Type":"ContainerStarted","Data":"40d829995a4821c0e98e7c324d2cc619839cf5f7135698cdbdee41e5d37230df"} Jun 12 20:13:52.450050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:52.450004 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-fpczf" podStartSLOduration=2.877673927 podStartE2EDuration="4.449990158s" totalImagesPullingTime="1.491712008s" totalInitContainerRuntime="80.604223ms" isStatefulPod=true podCreationTimestamp="2026-06-12 20:13:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:52.449070403 +0000 UTC m=+251.319495649" watchObservedRunningTime="2026-06-12 20:13:52.449990158 +0000 UTC m=+251.320415447" Jun 12 20:13:53.059915 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.059884 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-flgl4"] Jun 12 20:13:53.063034 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.063014 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.065551 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.065526 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jun 12 20:13:53.065649 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.065554 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-mm2sz\"" Jun 12 20:13:53.072468 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.072444 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-flgl4"] Jun 12 20:13:53.075218 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.075196 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:13:53.100508 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.100486 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:53.100591 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.100528 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:13:53.101640 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.101610 2579 patch_prober.go:28] interesting pod/console-c675f64bf-tkcxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 12 20:13:53.101709 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.101644 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 12 20:13:53.107170 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.107142 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:13:53.110109 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.110091 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.121230 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.121206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:13:53.173680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.173654 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.173773 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.173700 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qcqrb\" (UniqueName: \"kubernetes.io/projected/0241e18e-705d-49d5-a99e-1c48cd067ed6-kube-api-access-qcqrb\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.274077 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274048 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qcqrb\" (UniqueName: \"kubernetes.io/projected/0241e18e-705d-49d5-a99e-1c48cd067ed6-kube-api-access-qcqrb\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.274188 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274079 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274188 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274100 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274188 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274120 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274309 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274249 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-594ht\" (UniqueName: \"kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274385 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274365 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274506 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274492 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274574 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274533 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.274574 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.274563 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.274682 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:53.274668 2579 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jun 12 20:13:53.274735 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:13:53.274725 2579 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert podName:0241e18e-705d-49d5-a99e-1c48cd067ed6 nodeName:}" failed. No retries permitted until 2026-06-12 20:13:53.774708554 +0000 UTC m=+252.645133782 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert") pod "monitoring-plugin-589576dfc7-flgl4" (UID: "0241e18e-705d-49d5-a99e-1c48cd067ed6") : secret "monitoring-plugin-cert" not found Jun 12 20:13:53.284293 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.284268 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qcqrb\" (UniqueName: \"kubernetes.io/projected/0241e18e-705d-49d5-a99e-1c48cd067ed6-kube-api-access-qcqrb\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.375321 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375267 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375321 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375296 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375432 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375328 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375432 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375357 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375467 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375519 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.375644 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.375580 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-594ht\" (UniqueName: \"kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.376030 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.376000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.376203 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.376182 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.376265 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.376203 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.376352 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.376337 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.377646 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.377623 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.377849 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.377830 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.384242 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.384221 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-594ht\" (UniqueName: \"kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht\") pod \"console-56b655dfdf-qjkxn\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.418255 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.418235 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:13:53.476379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.476262 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:13:53.478427 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.478403 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/f3d69e07-ed28-422e-9944-4f3e0481a327-metrics-certs\") pod \"network-metrics-daemon-gldlc\" (UID: \"f3d69e07-ed28-422e-9944-4f3e0481a327\") " pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:13:53.539099 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.539071 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:13:53.541694 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:53.541664 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1850dcf_1454_40f7_93d7_d10c0a114238.slice/crio-b9be33338f25d345ad49eb935d8d8409cae37c72583622fa069d3d1cb0a87079 WatchSource:0}: Error finding container b9be33338f25d345ad49eb935d8d8409cae37c72583622fa069d3d1cb0a87079: Status 404 returned error can't find the container with id b9be33338f25d345ad49eb935d8d8409cae37c72583622fa069d3d1cb0a87079 Jun 12 20:13:53.573673 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.573649 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-gl8lm\"" Jun 12 20:13:53.580822 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.580192 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-gldlc" Jun 12 20:13:53.706728 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.706662 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-gldlc"] Jun 12 20:13:53.709094 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:53.709066 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d69e07_ed28_422e_9944_4f3e0481a327.slice/crio-fb16590467a8eaf33b0abb3e98a4a457051aebf4e1b13c4033b5a18027f2e8ef WatchSource:0}: Error finding container fb16590467a8eaf33b0abb3e98a4a457051aebf4e1b13c4033b5a18027f2e8ef: Status 404 returned error can't find the container with id fb16590467a8eaf33b0abb3e98a4a457051aebf4e1b13c4033b5a18027f2e8ef Jun 12 20:13:53.779295 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.779272 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.781481 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.781458 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/0241e18e-705d-49d5-a99e-1c48cd067ed6-monitoring-plugin-cert\") pod \"monitoring-plugin-589576dfc7-flgl4\" (UID: \"0241e18e-705d-49d5-a99e-1c48cd067ed6\") " pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:53.972269 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:53.972184 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:54.098780 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.098653 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-589576dfc7-flgl4"] Jun 12 20:13:54.101101 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:54.101080 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0241e18e_705d_49d5_a99e_1c48cd067ed6.slice/crio-1230c54aa582b049b4305c2e86a08c1e67f05b704582321bdb37cfb5e7429391 WatchSource:0}: Error finding container 1230c54aa582b049b4305c2e86a08c1e67f05b704582321bdb37cfb5e7429391: Status 404 returned error can't find the container with id 1230c54aa582b049b4305c2e86a08c1e67f05b704582321bdb37cfb5e7429391 Jun 12 20:13:54.421939 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.421908 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" event={"ID":"0241e18e-705d-49d5-a99e-1c48cd067ed6","Type":"ContainerStarted","Data":"1230c54aa582b049b4305c2e86a08c1e67f05b704582321bdb37cfb5e7429391"} Jun 12 20:13:54.423256 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.423230 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gldlc" event={"ID":"f3d69e07-ed28-422e-9944-4f3e0481a327","Type":"ContainerStarted","Data":"fb16590467a8eaf33b0abb3e98a4a457051aebf4e1b13c4033b5a18027f2e8ef"} Jun 12 20:13:54.424968 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.424928 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b655dfdf-qjkxn" event={"ID":"e1850dcf-1454-40f7-93d7-d10c0a114238","Type":"ContainerStarted","Data":"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d"} Jun 12 20:13:54.425096 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.424976 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b655dfdf-qjkxn" event={"ID":"e1850dcf-1454-40f7-93d7-d10c0a114238","Type":"ContainerStarted","Data":"b9be33338f25d345ad49eb935d8d8409cae37c72583622fa069d3d1cb0a87079"} Jun 12 20:13:54.442366 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.442324 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-56b655dfdf-qjkxn" podStartSLOduration=1.4423091430000001 podStartE2EDuration="1.442309143s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:54.440916574 +0000 UTC m=+253.311341820" watchObservedRunningTime="2026-06-12 20:13:54.442309143 +0000 UTC m=+253.312734388" Jun 12 20:13:54.494957 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.494930 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:13:54.500448 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.500428 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.507537 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507465 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 20:13:54.507537 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507465 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 20:13:54.507691 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507532 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 20:13:54.507691 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507539 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 20:13:54.507844 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507825 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 20:13:54.507916 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507855 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q549m\"" Jun 12 20:13:54.507916 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.507889 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 20:13:54.508389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508109 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 20:13:54.508389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508212 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 20:13:54.508389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508294 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 20:13:54.508558 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508399 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dqgcgngbkpsvu\"" Jun 12 20:13:54.508866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508629 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 20:13:54.508866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508638 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 20:13:54.508866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508652 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 20:13:54.508866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508668 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 20:13:54.508866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.508670 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 20:13:54.510357 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.510338 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 20:13:54.533494 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.533473 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:13:54.585842 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585810 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.585997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585847 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cscmf\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.585997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585884 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.585997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.585997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585956 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.585997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.585987 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586014 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586042 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586065 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586113 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586137 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586186 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586223 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586248 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586269 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586320 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586363 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.586416 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.586380 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687415 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687347 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687415 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687383 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687623 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687423 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687623 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687446 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687623 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687466 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687789 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687758 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687870 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687823 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cscmf\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687959 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687873 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687959 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687900 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687959 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687927 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.687959 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687927 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.687992 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688022 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688046 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688073 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688106 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688140 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688191 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688214 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688224 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.688247 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.688244 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.689666 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.689130 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.690826 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.690011 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.690826 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.690059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.690826 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.690659 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.691061 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.690973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.691285 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.691147 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.691737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.691714 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.692040 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.692019 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.692904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.692844 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.691528 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.692944 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693620 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693592 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693731 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693713 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693829 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693715 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693829 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693748 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693829 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693739 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.693996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.693957 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.700124 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.700105 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cscmf\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf\") pod \"prometheus-k8s-0\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.811745 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.811719 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:13:54.964873 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:54.964788 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:13:54.968225 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:13:54.968201 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5725a3a9_9920_4e69_8f6f_889858638a55.slice/crio-501956c5b471ca53e13564c231f338eb3e6eb8a11218c6e459b6e172ce8b06d1 WatchSource:0}: Error finding container 501956c5b471ca53e13564c231f338eb3e6eb8a11218c6e459b6e172ce8b06d1: Status 404 returned error can't find the container with id 501956c5b471ca53e13564c231f338eb3e6eb8a11218c6e459b6e172ce8b06d1 Jun 12 20:13:55.431710 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:55.431671 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"501956c5b471ca53e13564c231f338eb3e6eb8a11218c6e459b6e172ce8b06d1"} Jun 12 20:13:55.434057 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:55.434024 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gldlc" event={"ID":"f3d69e07-ed28-422e-9944-4f3e0481a327","Type":"ContainerStarted","Data":"c05d6918d53bef0634d60b9dd71a280ac301873146a51c78a8000411ab4f6f90"} Jun 12 20:13:55.434168 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:55.434071 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-gldlc" event={"ID":"f3d69e07-ed28-422e-9944-4f3e0481a327","Type":"ContainerStarted","Data":"0137dd7ef62c7b003d1fcec0dac101bb921696b1f54efd8e0ad78377fb1db644"} Jun 12 20:13:55.452474 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:55.452421 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-gldlc" podStartSLOduration=253.457552263 podStartE2EDuration="4m14.452401653s" totalImagesPullingTime="994.84939ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:09:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:55.451717684 +0000 UTC m=+254.322142930" watchObservedRunningTime="2026-06-12 20:13:55.452401653 +0000 UTC m=+254.322826883" Jun 12 20:13:56.439175 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.439088 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" event={"ID":"0241e18e-705d-49d5-a99e-1c48cd067ed6","Type":"ContainerStarted","Data":"cc1dab137bb2a75bfd8815ebd8daf48612b2f6d9edf34d6d247357b66cea4ea5"} Jun 12 20:13:56.439539 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.439185 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:56.440637 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.440608 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" exitCode=0 Jun 12 20:13:56.440730 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.440690 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} Jun 12 20:13:56.444085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.444063 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" Jun 12 20:13:56.454997 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:13:56.454956 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-589576dfc7-flgl4" podStartSLOduration=1.5040595429999999 podStartE2EDuration="3.454943179s" totalImagesPullingTime="1.950883636s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:13:56.453423988 +0000 UTC m=+255.323849223" watchObservedRunningTime="2026-06-12 20:13:56.454943179 +0000 UTC m=+255.325368481" Jun 12 20:14:00.464647 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:00.464614 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} Jun 12 20:14:00.465058 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:00.464715 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} Jun 12 20:14:01.472865 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:01.472767 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} Jun 12 20:14:01.472865 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:01.472840 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} Jun 12 20:14:01.472865 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:01.472869 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} Jun 12 20:14:02.480114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:02.480079 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerStarted","Data":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} Jun 12 20:14:02.510977 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:02.510928 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.69331437 podStartE2EDuration="8.510912632s" totalImagesPullingTime="5.79639606s" totalInitContainerRuntime="21.202202ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:13:54 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:14:02.508554938 +0000 UTC m=+261.378980202" watchObservedRunningTime="2026-06-12 20:14:02.510912632 +0000 UTC m=+261.381337877" Jun 12 20:14:03.100386 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.100355 2579 patch_prober.go:28] interesting pod/console-c675f64bf-tkcxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 12 20:14:03.100545 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.100406 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 12 20:14:03.418906 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.418824 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:14:03.418906 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.418882 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:14:03.419955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.419936 2579 patch_prober.go:28] interesting pod/console-56b655dfdf-qjkxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 12 20:14:03.420004 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:03.419975 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56b655dfdf-qjkxn" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 12 20:14:04.812480 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:04.812449 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:14:13.101230 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:13.101197 2579 patch_prober.go:28] interesting pod/console-c675f64bf-tkcxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 12 20:14:13.101576 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:13.101250 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 12 20:14:13.419130 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:13.419054 2579 patch_prober.go:28] interesting pod/console-56b655dfdf-qjkxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 12 20:14:13.419130 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:13.419096 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56b655dfdf-qjkxn" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 12 20:14:18.094462 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:18.094404 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7f98569f95-h9vsm" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerName="console" containerID="cri-o://feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25" gracePeriod=15 Jun 12 20:14:20.552708 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:20.552676 2579 generic.go:356] "Generic (PLEG): container finished" podID="b2f63188-3019-4729-b8a8-1775c069cda1" containerID="f70032d2d7fae7f52ea49065a493d0d124b57135ca61cdc2f0ec6047ec3e74cf" exitCode=0 Jun 12 20:14:20.553107 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:20.552731 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" event={"ID":"b2f63188-3019-4729-b8a8-1775c069cda1","Type":"ContainerDied","Data":"f70032d2d7fae7f52ea49065a493d0d124b57135ca61cdc2f0ec6047ec3e74cf"} Jun 12 20:14:20.553107 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:20.553009 2579 scope.go:117] "RemoveContainer" containerID="f70032d2d7fae7f52ea49065a493d0d124b57135ca61cdc2f0ec6047ec3e74cf" Jun 12 20:14:21.557588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:21.557552 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7ccbfd59dc-8m4hl" event={"ID":"b2f63188-3019-4729-b8a8-1775c069cda1","Type":"ContainerStarted","Data":"ccd0b33ad5beca293ea8ccc3b21f3f07ca037d346c2c270b3dd0e69168ec91e5"} Jun 12 20:14:23.100402 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:23.100372 2579 patch_prober.go:28] interesting pod/console-c675f64bf-tkcxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 12 20:14:23.100772 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:23.100417 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 12 20:14:23.419591 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:23.419501 2579 patch_prober.go:28] interesting pod/console-56b655dfdf-qjkxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 12 20:14:23.419591 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:23.419571 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56b655dfdf-qjkxn" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 12 20:14:27.095572 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:27.095523 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-mvs42" podUID="70eee006-4f8c-4aa6-9e12-084be5161b3e" Jun 12 20:14:27.584299 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:27.584263 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:28.589721 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.589693 2579 generic.go:356] "Generic (PLEG): container finished" podID="b7270edd-828a-4c5f-8770-07d168f4e47f" containerID="968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0" exitCode=255 Jun 12 20:14:28.590166 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.589771 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerDied","Data":"968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0"} Jun 12 20:14:28.590166 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.589840 2579 scope.go:117] "RemoveContainer" containerID="9708eaf4006c911d63a42c5da866d52f50a151dac03630e92e5c6aeec689d39a" Jun 12 20:14:28.591739 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.591720 2579 generic.go:356] "Generic (PLEG): container finished" podID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" containerID="5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7" exitCode=1 Jun 12 20:14:28.591871 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.591755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerDied","Data":"5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7"} Jun 12 20:14:28.592074 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.592060 2579 scope.go:117] "RemoveContainer" containerID="5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7" Jun 12 20:14:28.592255 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:28.592237 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6858bdfb74-2qw5s_open-cluster-management-agent-addon(fd8fa019-e1b9-4e45-8efb-9a479165bc41)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" podUID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" Jun 12 20:14:28.596039 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.596022 2579 scope.go:117] "RemoveContainer" containerID="968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0" Jun 12 20:14:28.596163 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:28.596146 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8_open-cluster-management-agent-addon(b7270edd-828a-4c5f-8770-07d168f4e47f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" podUID="b7270edd-828a-4c5f-8770-07d168f4e47f" Jun 12 20:14:28.600264 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:28.600248 2579 scope.go:117] "RemoveContainer" containerID="44d080acdffd095182f52f4f06bf12170953589a4349f64990ace2171279f6eb" Jun 12 20:14:29.116507 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:29.116475 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:14:29.596577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:29.596552 2579 scope.go:117] "RemoveContainer" containerID="5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7" Jun 12 20:14:29.596999 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:29.596740 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6858bdfb74-2qw5s_open-cluster-management-agent-addon(fd8fa019-e1b9-4e45-8efb-9a479165bc41)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" podUID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" Jun 12 20:14:30.359936 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:30.359901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:30.362188 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:30.362166 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/70eee006-4f8c-4aa6-9e12-084be5161b3e-metrics-tls\") pod \"dns-default-mvs42\" (UID: \"70eee006-4f8c-4aa6-9e12-084be5161b3e\") " pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:30.587917 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:30.587890 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-rxxkq\"" Jun 12 20:14:30.595755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:30.595730 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:30.748005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:30.747980 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-mvs42"] Jun 12 20:14:30.750507 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:14:30.750477 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70eee006_4f8c_4aa6_9e12_084be5161b3e.slice/crio-dbe1b46f0348139785e6d36cee6e2e1adc77b8e28a479f8cbf5d5ffe000bcb37 WatchSource:0}: Error finding container dbe1b46f0348139785e6d36cee6e2e1adc77b8e28a479f8cbf5d5ffe000bcb37: Status 404 returned error can't find the container with id dbe1b46f0348139785e6d36cee6e2e1adc77b8e28a479f8cbf5d5ffe000bcb37 Jun 12 20:14:31.168367 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.168343 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" Jun 12 20:14:31.168674 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.168660 2579 scope.go:117] "RemoveContainer" containerID="968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0" Jun 12 20:14:31.168828 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:31.168790 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8_open-cluster-management-agent-addon(b7270edd-828a-4c5f-8770-07d168f4e47f)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" podUID="b7270edd-828a-4c5f-8770-07d168f4e47f" Jun 12 20:14:31.180118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.180097 2579 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:14:31.180372 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.180360 2579 scope.go:117] "RemoveContainer" containerID="5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7" Jun 12 20:14:31.180495 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:31.180479 2579 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-6858bdfb74-2qw5s_open-cluster-management-agent-addon(fd8fa019-e1b9-4e45-8efb-9a479165bc41)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" podUID="fd8fa019-e1b9-4e45-8efb-9a479165bc41" Jun 12 20:14:31.519040 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.519015 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:14:31.606017 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.605970 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvs42" event={"ID":"70eee006-4f8c-4aa6-9e12-084be5161b3e","Type":"ContainerStarted","Data":"dbe1b46f0348139785e6d36cee6e2e1adc77b8e28a479f8cbf5d5ffe000bcb37"} Jun 12 20:14:31.607276 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.607249 2579 generic.go:356] "Generic (PLEG): container finished" podID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerID="feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25" exitCode=0 Jun 12 20:14:31.607276 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.607279 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98569f95-h9vsm" event={"ID":"c13379b1-c7a1-4b27-ae66-c28f218b917f","Type":"ContainerDied","Data":"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25"} Jun 12 20:14:31.607452 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.607299 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7f98569f95-h9vsm" Jun 12 20:14:31.607452 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.607311 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7f98569f95-h9vsm" event={"ID":"c13379b1-c7a1-4b27-ae66-c28f218b917f","Type":"ContainerDied","Data":"0eb13ce69de0aced0c6842b35e52da7493e5ffc23ca234ea363bc280a7671d4f"} Jun 12 20:14:31.607452 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.607328 2579 scope.go:117] "RemoveContainer" containerID="feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25" Jun 12 20:14:31.617301 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.617277 2579 scope.go:117] "RemoveContainer" containerID="feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25" Jun 12 20:14:31.617564 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:14:31.617538 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25\": container with ID starting with feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25 not found: ID does not exist" containerID="feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25" Jun 12 20:14:31.617659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.617573 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25"} err="failed to get container status \"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25\": rpc error: code = NotFound desc = could not find container \"feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25\": container with ID starting with feacb666eae45af67f15e65f64785c6c25a0a72017a00f70c54c2bc2c93e3a25 not found: ID does not exist" Jun 12 20:14:31.671383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671359 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.671588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671430 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qtwzn\" (UniqueName: \"kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.671588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671484 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.671588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671512 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.671588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671542 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.671782 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671609 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert\") pod \"c13379b1-c7a1-4b27-ae66-c28f218b917f\" (UID: \"c13379b1-c7a1-4b27-ae66-c28f218b917f\") " Jun 12 20:14:31.672139 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.671878 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca" (OuterVolumeSpecName: "service-ca") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:14:31.672139 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.672128 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config" (OuterVolumeSpecName: "console-config") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:14:31.672299 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.672192 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:14:31.674029 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.674001 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn" (OuterVolumeSpecName: "kube-api-access-qtwzn") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "kube-api-access-qtwzn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:14:31.674159 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.674132 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:14:31.674476 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.674452 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c13379b1-c7a1-4b27-ae66-c28f218b917f" (UID: "c13379b1-c7a1-4b27-ae66-c28f218b917f"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:14:31.772696 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772670 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qtwzn\" (UniqueName: \"kubernetes.io/projected/c13379b1-c7a1-4b27-ae66-c28f218b917f-kube-api-access-qtwzn\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.772696 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772692 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-oauth-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.773084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772702 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.773084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772711 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c13379b1-c7a1-4b27-ae66-c28f218b917f-console-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.773084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772719 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-oauth-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.773084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.772728 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c13379b1-c7a1-4b27-ae66-c28f218b917f-service-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:14:31.931575 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.931533 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:14:31.936227 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:31.936203 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7f98569f95-h9vsm"] Jun 12 20:14:33.100987 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.100952 2579 patch_prober.go:28] interesting pod/console-c675f64bf-tkcxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" start-of-body= Jun 12 20:14:33.101285 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.100998 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" probeResult="failure" output="Get \"https://10.134.0.15:8443/health\": dial tcp 10.134.0.15:8443: connect: connection refused" Jun 12 20:14:33.419556 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.419519 2579 patch_prober.go:28] interesting pod/console-56b655dfdf-qjkxn container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" start-of-body= Jun 12 20:14:33.419730 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.419581 2579 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-56b655dfdf-qjkxn" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" probeResult="failure" output="Get \"https://10.134.0.19:8443/health\": dial tcp 10.134.0.19:8443: connect: connection refused" Jun 12 20:14:33.573661 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.573631 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" path="/var/lib/kubelet/pods/c13379b1-c7a1-4b27-ae66-c28f218b917f/volumes" Jun 12 20:14:33.622912 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.622880 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvs42" event={"ID":"70eee006-4f8c-4aa6-9e12-084be5161b3e","Type":"ContainerStarted","Data":"851fb9bdac84d5f6ff0c520c0c2a7ce6770312253b008b05c260dcacf775063a"} Jun 12 20:14:33.623054 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.622964 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-mvs42" event={"ID":"70eee006-4f8c-4aa6-9e12-084be5161b3e","Type":"ContainerStarted","Data":"0c31246ff288956c98c18a67349259fd9f95260de9b5f39163c13151d6a8a9f3"} Jun 12 20:14:33.623054 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.623020 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:33.640977 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:33.640939 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-mvs42" podStartSLOduration=251.495049455 podStartE2EDuration="4m13.640926392s" totalImagesPullingTime="2.145876937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:10:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:14:33.639159085 +0000 UTC m=+292.509584345" watchObservedRunningTime="2026-06-12 20:14:33.640926392 +0000 UTC m=+292.511351637" Jun 12 20:14:34.086191 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:34.086162 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-state-metrics/0.log" Jun 12 20:14:34.273402 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:34.273374 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-rbac-proxy-main/0.log" Jun 12 20:14:34.472656 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:34.472587 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-rbac-proxy-self/0.log" Jun 12 20:14:34.873066 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:34.873036 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-flgl4_0241e18e-705d-49d5-a99e-1c48cd067ed6/monitoring-plugin/0.log" Jun 12 20:14:35.673289 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:35.673262 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/init-textfile/0.log" Jun 12 20:14:35.874032 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:35.874007 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/node-exporter/0.log" Jun 12 20:14:36.073314 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:36.073288 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/kube-rbac-proxy/0.log" Jun 12 20:14:36.872968 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:36.872935 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/kube-rbac-proxy-main/0.log" Jun 12 20:14:37.072606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:37.072574 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/kube-rbac-proxy-self/0.log" Jun 12 20:14:37.273389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:37.273364 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/openshift-state-metrics/0.log" Jun 12 20:14:37.473471 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:37.473447 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/init-config-reloader/0.log" Jun 12 20:14:37.673853 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:37.673779 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/prometheus/0.log" Jun 12 20:14:37.874322 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:37.874297 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/config-reloader/0.log" Jun 12 20:14:38.073425 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:38.073395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/thanos-sidecar/0.log" Jun 12 20:14:38.273772 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:38.273748 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/kube-rbac-proxy-web/0.log" Jun 12 20:14:38.473459 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:38.473390 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/kube-rbac-proxy/0.log" Jun 12 20:14:38.673537 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:38.673510 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_5725a3a9-9920-4e69-8f6f-889858638a55/kube-rbac-proxy-thanos/0.log" Jun 12 20:14:41.274035 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:41.274008 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-56b655dfdf-qjkxn_e1850dcf-1454-40f7-93d7-d10c0a114238/console/0.log" Jun 12 20:14:41.528333 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:41.528309 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:14:41.530295 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:41.530272 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:14:41.533429 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:41.533411 2579 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 20:14:41.674709 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:41.674595 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-c675f64bf-tkcxn_7c86e524-c3e9-4b21-8451-d9ff1d24318d/console/0.log" Jun 12 20:14:42.873379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:42.873351 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvs42_70eee006-4f8c-4aa6-9e12-084be5161b3e/dns/0.log" Jun 12 20:14:43.072567 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.072539 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvs42_70eee006-4f8c-4aa6-9e12-084be5161b3e/kube-rbac-proxy/0.log" Jun 12 20:14:43.104725 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.104698 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:14:43.108529 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.108505 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:14:43.422379 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.422347 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:14:43.427618 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.427594 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:14:43.472592 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.472570 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffk9h_e8d200bc-f584-417e-9d47-826ad9507d62/dns-node-resolver/0.log" Jun 12 20:14:43.485629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.485605 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:14:43.569910 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.569885 2579 scope.go:117] "RemoveContainer" containerID="5125baae4ec960cccbe6b085a20f2ff9c23799363cece250d43e50a36ae897f7" Jun 12 20:14:43.630132 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.630112 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-mvs42" Jun 12 20:14:43.670333 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.670300 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" event={"ID":"fd8fa019-e1b9-4e45-8efb-9a479165bc41","Type":"ContainerStarted","Data":"f7729073c693118d3904d68ac317c649c6840eb58470b655f3e66c76e7067740"} Jun 12 20:14:43.671236 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.671177 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:14:43.672690 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:43.672633 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-6858bdfb74-2qw5s" Jun 12 20:14:44.575498 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:44.575466 2579 scope.go:117] "RemoveContainer" containerID="968f282f9c9d81a1aba50b1f1665adeb7c0b3bb7d72d0c6624a68f4ca51ca1f0" Jun 12 20:14:44.676620 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:44.676586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-6dbf9bf596-rv8s8" event={"ID":"b7270edd-828a-4c5f-8770-07d168f4e47f","Type":"ContainerStarted","Data":"108c94cd60d96f3dc93181a9f37626e15c2ea5a1fd648463f86d24a6642bb77d"} Jun 12 20:14:44.873269 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:44.873187 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8p5x_cbc778f6-80ac-4480-bc10-55479741f6ba/node-ca/0.log" Jun 12 20:14:45.476191 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:45.476163 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgsxb_c61ef41a-e865-48c9-8500-f06b2359daac/serve-healthcheck-canary/0.log" Jun 12 20:14:54.812659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:54.812626 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:14:54.831697 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:54.831674 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:14:55.736810 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:14:55.736768 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:09.696836 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.696753 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-c675f64bf-tkcxn" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" containerID="cri-o://fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473" gracePeriod=15 Jun 12 20:15:09.942468 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.942446 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:15:09.961054 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961001 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961054 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961034 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961167 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dsnmz\" (UniqueName: \"kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961201 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961322 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961247 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961322 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961272 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961322 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961296 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert\") pod \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\" (UID: \"7c86e524-c3e9-4b21-8451-d9ff1d24318d\") " Jun 12 20:15:09.961419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961393 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config" (OuterVolumeSpecName: "console-config") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.961419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961405 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca" (OuterVolumeSpecName: "service-ca") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.961701 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961674 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.961701 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961701 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-service-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:09.961886 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961779 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.961886 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.961785 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:09.963424 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.963399 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz" (OuterVolumeSpecName: "kube-api-access-dsnmz") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "kube-api-access-dsnmz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:09.963651 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.963623 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:09.963755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:09.963694 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "7c86e524-c3e9-4b21-8451-d9ff1d24318d" (UID: "7c86e524-c3e9-4b21-8451-d9ff1d24318d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:10.062591 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.062566 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-trusted-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.062591 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.062588 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/7c86e524-c3e9-4b21-8451-d9ff1d24318d-oauth-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.062769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.062597 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.062769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.062606 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dsnmz\" (UniqueName: \"kubernetes.io/projected/7c86e524-c3e9-4b21-8451-d9ff1d24318d-kube-api-access-dsnmz\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.062769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.062614 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/7c86e524-c3e9-4b21-8451-d9ff1d24318d-console-oauth-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:10.780480 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.780444 2579 generic.go:356] "Generic (PLEG): container finished" podID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerID="fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473" exitCode=0 Jun 12 20:15:10.780963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.780494 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c675f64bf-tkcxn" Jun 12 20:15:10.780963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.780522 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c675f64bf-tkcxn" event={"ID":"7c86e524-c3e9-4b21-8451-d9ff1d24318d","Type":"ContainerDied","Data":"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473"} Jun 12 20:15:10.780963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.780586 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c675f64bf-tkcxn" event={"ID":"7c86e524-c3e9-4b21-8451-d9ff1d24318d","Type":"ContainerDied","Data":"647d9ae24c121dfe9a96656bb0b342be7f7a87a84b418787ddf901393407debe"} Jun 12 20:15:10.780963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.780622 2579 scope.go:117] "RemoveContainer" containerID="fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473" Jun 12 20:15:10.789727 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.789699 2579 scope.go:117] "RemoveContainer" containerID="fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473" Jun 12 20:15:10.790045 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:10.790023 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473\": container with ID starting with fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473 not found: ID does not exist" containerID="fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473" Jun 12 20:15:10.790148 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.790050 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473"} err="failed to get container status \"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473\": rpc error: code = NotFound desc = could not find container \"fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473\": container with ID starting with fedbc5f4f4b9935c4fa1dbcfafd71a5321d2b2bfa774610f3b52f252de531473 not found: ID does not exist" Jun 12 20:15:10.802130 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.802109 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:15:10.805744 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:10.805722 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c675f64bf-tkcxn"] Jun 12 20:15:11.573841 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:11.573811 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" path="/var/lib/kubelet/pods/7c86e524-c3e9-4b21-8451-d9ff1d24318d/volumes" Jun 12 20:15:12.856208 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856177 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:12.856604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856438 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="prometheus" containerID="cri-o://d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" gracePeriod=600 Jun 12 20:15:12.856604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856475 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy" containerID="cri-o://2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" gracePeriod=600 Jun 12 20:15:12.856604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856505 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-thanos" containerID="cri-o://8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" gracePeriod=600 Jun 12 20:15:12.856604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856509 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-web" containerID="cri-o://0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" gracePeriod=600 Jun 12 20:15:12.856834 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856505 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="thanos-sidecar" containerID="cri-o://b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" gracePeriod=600 Jun 12 20:15:12.856834 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:12.856520 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="config-reloader" containerID="cri-o://9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" gracePeriod=600 Jun 12 20:15:13.094233 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.094206 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.181450 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181374 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181450 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181405 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181450 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181430 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181457 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cscmf\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181473 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181498 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181520 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181539 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181564 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.181717 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181710 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181741 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181769 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181769 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181833 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181860 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181888 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181913 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181942 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.181979 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182003 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182046 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls\") pod \"5725a3a9-9920-4e69-8f6f-889858638a55\" (UID: \"5725a3a9-9920-4e69-8f6f-889858638a55\") " Jun 12 20:15:13.182075 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182046 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.182629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182071 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.182629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182397 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.182629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182440 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.182629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182459 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.182629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.182490 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.183035 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.183003 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.183444 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.183418 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.183692 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.183664 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:13.185206 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.185168 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:15:13.185497 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.185469 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf" (OuterVolumeSpecName: "kube-api-access-cscmf") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "kube-api-access-cscmf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:13.185743 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.185718 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.186174 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186148 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.186615 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186583 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.186698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186643 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.186698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186661 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config" (OuterVolumeSpecName: "config") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.186838 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186734 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:13.186901 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186877 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.187016 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.186998 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.187116 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.187097 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out" (OuterVolumeSpecName: "config-out") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 20:15:13.187606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.187576 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.195134 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.195111 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config" (OuterVolumeSpecName: "web-config") pod "5725a3a9-9920-4e69-8f6f-889858638a55" (UID: "5725a3a9-9920-4e69-8f6f-889858638a55"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:13.283141 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283110 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283141 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283137 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283147 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283156 2579 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-config-out\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283166 2579 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-tls-assets\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283174 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-db\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283182 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283190 2579 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-prometheus-k8s-tls\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283198 2579 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-thanos-prometheus-http-client-file\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283206 2579 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-grpc-tls\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283215 2579 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-prometheus-trusted-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283223 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cscmf\" (UniqueName: \"kubernetes.io/projected/5725a3a9-9920-4e69-8f6f-889858638a55-kube-api-access-cscmf\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283232 2579 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-metrics-client-certs\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283240 2579 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-secret-kube-rbac-proxy\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283247 2579 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5725a3a9-9920-4e69-8f6f-889858638a55-configmap-metrics-client-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283256 2579 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-web-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.283273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.283264 2579 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5725a3a9-9920-4e69-8f6f-889858638a55-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:13.795695 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795666 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" exitCode=0 Jun 12 20:15:13.795695 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795690 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" exitCode=0 Jun 12 20:15:13.795695 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795696 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" exitCode=0 Jun 12 20:15:13.795695 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795702 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" exitCode=0 Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795707 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" exitCode=0 Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795713 2579 generic.go:356] "Generic (PLEG): container finished" podID="5725a3a9-9920-4e69-8f6f-889858638a55" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" exitCode=0 Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795737 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795755 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795845 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795874 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795904 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795913 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.795953 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795943 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} Jun 12 20:15:13.796317 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.795982 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} Jun 12 20:15:13.796317 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.796020 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5725a3a9-9920-4e69-8f6f-889858638a55","Type":"ContainerDied","Data":"501956c5b471ca53e13564c231f338eb3e6eb8a11218c6e459b6e172ce8b06d1"} Jun 12 20:15:13.803164 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.803147 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.809550 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.809531 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.816604 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.816580 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.817085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.817066 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:13.822128 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.822107 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:13.823764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.823752 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.829998 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.829982 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.837114 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.837093 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.844672 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.844636 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.844936 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.844919 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.846590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.845060 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.846590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.845266 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.847885 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848426 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-thanos" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848443 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-thanos" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848464 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848472 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848483 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="config-reloader" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848492 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="config-reloader" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848509 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-web" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848517 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-web" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848528 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="init-config-reloader" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848537 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="init-config-reloader" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848562 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848571 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848581 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="thanos-sidecar" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848589 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="thanos-sidecar" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848607 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848615 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848638 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="prometheus" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848647 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="prometheus" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848762 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-thanos" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848775 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy-web" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848790 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="thanos-sidecar" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848814 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c13379b1-c7a1-4b27-ae66-c28f218b917f" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848823 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="kube-rbac-proxy" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848842 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="prometheus" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848851 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="7c86e524-c3e9-4b21-8451-d9ff1d24318d" containerName="console" Jun 12 20:15:13.849904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.848865 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" containerName="config-reloader" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.850430 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.850455 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.850476 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.850761 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.850810 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.850975 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.850836 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.851222 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.851192 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.851264 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851224 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.851264 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851244 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.851481 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.851466 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.851536 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851485 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.851536 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851496 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.851724 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.851706 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.851787 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851731 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.851787 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.851751 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.852146 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:13.852126 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.852201 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.852163 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.852255 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.852208 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.852620 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.852585 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.852680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.852624 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.853024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853002 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.853024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853024 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.853142 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853123 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.853251 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853233 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.853306 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853252 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.853597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853568 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.853684 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853604 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.853964 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853929 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.854035 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.853966 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.854220 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854204 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.854270 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854223 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.854465 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854450 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.854526 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854466 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.854702 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854683 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.854766 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854702 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.854932 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854916 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.854932 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.854932 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.855191 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855174 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.855240 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855191 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.855456 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855433 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.855456 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855454 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.855690 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855666 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.855755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855690 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.855755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855710 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 20:15:13.855755 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.855711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 20:15:13.856030 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856009 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.856110 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856032 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.856273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856245 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856288 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856311 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856363 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856523 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-q549m\"" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856551 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.856595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856574 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.856921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856576 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 20:15:13.856921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856729 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 20:15:13.856921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856821 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.856921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856846 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.856921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.856880 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 20:15:13.857145 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857097 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 20:15:13.857145 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857101 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.857145 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857128 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.857419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857389 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.857419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857419 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.857573 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857432 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-dqgcgngbkpsvu\"" Jun 12 20:15:13.857573 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857444 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 20:15:13.857696 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857673 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.857762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857699 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.857762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857723 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 20:15:13.857894 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857868 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 20:15:13.857958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.857940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 20:15:13.858042 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858016 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.858147 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858073 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.858261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858245 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 20:15:13.858349 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858323 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.858414 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858353 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.858650 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858599 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.858650 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858623 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.858923 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858906 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.858990 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.858928 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.859243 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859216 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.859335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859269 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.859532 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859505 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.859532 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859531 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.860048 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859872 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.860048 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.859904 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.860200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860102 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 20:15:13.860200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860163 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.860200 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860183 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.860447 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860421 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.860516 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860449 2579 scope.go:117] "RemoveContainer" containerID="8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc" Jun 12 20:15:13.860749 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860702 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc"} err="failed to get container status \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": rpc error: code = NotFound desc = could not find container \"8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc\": container with ID starting with 8ccf2441d38135bbba5c47f732c03f702a9359bea557722e35a321cf8fc222bc not found: ID does not exist" Jun 12 20:15:13.860749 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.860745 2579 scope.go:117] "RemoveContainer" containerID="2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7" Jun 12 20:15:13.861780 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.861755 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7"} err="failed to get container status \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": rpc error: code = NotFound desc = could not find container \"2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7\": container with ID starting with 2c681a62628701f88e9b1663c764aed05d19473dc87d77268ba4021a2ae0e6e7 not found: ID does not exist" Jun 12 20:15:13.861878 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.861780 2579 scope.go:117] "RemoveContainer" containerID="0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864" Jun 12 20:15:13.862100 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862078 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864"} err="failed to get container status \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": rpc error: code = NotFound desc = could not find container \"0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864\": container with ID starting with 0d3c71a28ade10c5c09b44b208c5a0352a1cb7b772db43f4745ef27f6c42a864 not found: ID does not exist" Jun 12 20:15:13.862167 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862101 2579 scope.go:117] "RemoveContainer" containerID="b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8" Jun 12 20:15:13.862333 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862313 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8"} err="failed to get container status \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": rpc error: code = NotFound desc = could not find container \"b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8\": container with ID starting with b52310c9387c6fd9d8208816e5972998f2ba381bbab9cc16de067925ee052ea8 not found: ID does not exist" Jun 12 20:15:13.862385 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862334 2579 scope.go:117] "RemoveContainer" containerID="9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4" Jun 12 20:15:13.862570 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862551 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4"} err="failed to get container status \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": rpc error: code = NotFound desc = could not find container \"9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4\": container with ID starting with 9dd728b9ae14f442d4c9de152faaec9cb228eabb1e1090f3bc7481645d8743d4 not found: ID does not exist" Jun 12 20:15:13.862639 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862574 2579 scope.go:117] "RemoveContainer" containerID="d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab" Jun 12 20:15:13.862811 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862771 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 20:15:13.862860 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862775 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab"} err="failed to get container status \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": rpc error: code = NotFound desc = could not find container \"d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab\": container with ID starting with d72e7957677dfa885977159a2192ddcd3e2e3a8ecb623a8dd54e1f72db05c0ab not found: ID does not exist" Jun 12 20:15:13.862860 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.862830 2579 scope.go:117] "RemoveContainer" containerID="e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3" Jun 12 20:15:13.863085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.863060 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3"} err="failed to get container status \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": rpc error: code = NotFound desc = could not find container \"e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3\": container with ID starting with e78ee9edaec0c6100e1507141f1cbb7a1f828a10b11efba50230546b0ea677e3 not found: ID does not exist" Jun 12 20:15:13.869357 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.869337 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:13.887617 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887579 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.887764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887621 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.887764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887653 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.887764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887682 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.887764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887733 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887773 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887829 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887861 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887944 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888002 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.887966 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888012 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888061 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888089 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888117 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888134 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888151 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888169 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.888261 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.888184 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhq5c\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-kube-api-access-zhq5c\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.988878 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.988858 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.988999 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.988901 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.988999 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.988929 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989101 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989037 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989101 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989066 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989099 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989166 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989194 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989223 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989240 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989260 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989277 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhq5c\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-kube-api-access-zhq5c\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989336 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989314 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989345 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989364 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989408 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989436 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989519 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.989659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989630 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.990011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.989741 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.990736 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.990622 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.991093 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.991061 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.991644 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.991585 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993057 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993018 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993327 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993531 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config-out\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993577 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993537 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-web-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993767 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993698 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993900 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/718b41c4-0eb7-48f8-abdb-b883e352aeb2-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.993991 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.993960 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.994400 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.994370 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-config\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.994588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.994562 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.994700 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.994655 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.994769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.994696 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.994976 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.994950 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.995243 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.995226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/718b41c4-0eb7-48f8-abdb-b883e352aeb2-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:13.997840 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:13.997822 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhq5c\" (UniqueName: \"kubernetes.io/projected/718b41c4-0eb7-48f8-abdb-b883e352aeb2-kube-api-access-zhq5c\") pod \"prometheus-k8s-0\" (UID: \"718b41c4-0eb7-48f8-abdb-b883e352aeb2\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:14.164642 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:14.164583 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:14.295731 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:14.295706 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 20:15:14.296465 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:15:14.296429 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod718b41c4_0eb7_48f8_abdb_b883e352aeb2.slice/crio-dd8d4e49f57bc979919d1a533bd64c4403ae209e5ab817b9dcb6fd70c6858961 WatchSource:0}: Error finding container dd8d4e49f57bc979919d1a533bd64c4403ae209e5ab817b9dcb6fd70c6858961: Status 404 returned error can't find the container with id dd8d4e49f57bc979919d1a533bd64c4403ae209e5ab817b9dcb6fd70c6858961 Jun 12 20:15:14.802542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:14.802514 2579 generic.go:356] "Generic (PLEG): container finished" podID="718b41c4-0eb7-48f8-abdb-b883e352aeb2" containerID="f2e94155cb29af7d8ea95d6951ace36dfbc8e15e3803b52efc4f105181674bec" exitCode=0 Jun 12 20:15:14.802699 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:14.802554 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerDied","Data":"f2e94155cb29af7d8ea95d6951ace36dfbc8e15e3803b52efc4f105181674bec"} Jun 12 20:15:14.802699 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:14.802600 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"dd8d4e49f57bc979919d1a533bd64c4403ae209e5ab817b9dcb6fd70c6858961"} Jun 12 20:15:15.578460 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.576256 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5725a3a9-9920-4e69-8f6f-889858638a55" path="/var/lib/kubelet/pods/5725a3a9-9920-4e69-8f6f-889858638a55/volumes" Jun 12 20:15:15.809994 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.809961 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"f46c661432f5e2c9b18e350665062af2c531204dff91313f88ace0939c7a4ad3"} Jun 12 20:15:15.810173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.810025 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"643fc7ffb1e5e80390231cb471afef178744eb2f63015e5d931023649dc759a2"} Jun 12 20:15:15.810173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.810050 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"56337a3649ae4d078728602a9662c0bd3ecefccaa33bd3ef5d7bd0ee3971779e"} Jun 12 20:15:15.810173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.810075 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"54f83a446e6f5402cfb514971ab7749ac896b32d16745eff0d5a09e26209cf02"} Jun 12 20:15:15.810173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.810099 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"3cf4ca6bcf428d92ab5b0e679269c1ad1791d8f5c28d6c2dcff43d4657abffda"} Jun 12 20:15:15.810173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.810122 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"718b41c4-0eb7-48f8-abdb-b883e352aeb2","Type":"ContainerStarted","Data":"77a180013f5e6aeb3722e97d3826cd7dfae4ef07075bcb77758490b6aca10ac3"} Jun 12 20:15:15.840210 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:15.840086 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.822604352 podStartE2EDuration="2.840066019s" totalImagesPullingTime="0s" totalInitContainerRuntime="17.461667ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:15:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:15:15.837518969 +0000 UTC m=+334.707944243" watchObservedRunningTime="2026-06-12 20:15:15.840066019 +0000 UTC m=+334.710491265" Jun 12 20:15:17.086762 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.086727 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:15:17.089263 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.089240 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.104019 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.104000 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:15:17.113769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113736 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.113769 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113767 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.114011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113787 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.114011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113844 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.114011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113882 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jccgh\" (UniqueName: \"kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.114011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113949 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.114011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.113971 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214453 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214421 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214462 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214490 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214513 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214537 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jccgh\" (UniqueName: \"kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214818 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214605 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.214818 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.214632 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.215217 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.215190 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.215324 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.215226 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.215324 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.215241 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.215412 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.215389 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.217127 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.217102 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.217193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.217138 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.223025 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.223000 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jccgh\" (UniqueName: \"kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh\") pod \"console-85ffd854cc-jns9h\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.398279 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.398212 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:17.522778 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.522754 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:15:17.525138 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:15:17.525109 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99e628e_7ad1_4d0b_9a36_0804b036e774.slice/crio-72cbfcb721c4bca7ac58228f6479840ece196b560690e4d20f37bc45fc2f1a1d WatchSource:0}: Error finding container 72cbfcb721c4bca7ac58228f6479840ece196b560690e4d20f37bc45fc2f1a1d: Status 404 returned error can't find the container with id 72cbfcb721c4bca7ac58228f6479840ece196b560690e4d20f37bc45fc2f1a1d Jun 12 20:15:17.818977 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.818942 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85ffd854cc-jns9h" event={"ID":"c99e628e-7ad1-4d0b-9a36-0804b036e774","Type":"ContainerStarted","Data":"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e"} Jun 12 20:15:17.819110 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.818998 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85ffd854cc-jns9h" event={"ID":"c99e628e-7ad1-4d0b-9a36-0804b036e774","Type":"ContainerStarted","Data":"72cbfcb721c4bca7ac58228f6479840ece196b560690e4d20f37bc45fc2f1a1d"} Jun 12 20:15:17.835980 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:17.835915 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-85ffd854cc-jns9h" podStartSLOduration=0.835900764 podStartE2EDuration="835.900764ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:15:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:15:17.835143554 +0000 UTC m=+336.705568801" watchObservedRunningTime="2026-06-12 20:15:17.835900764 +0000 UTC m=+336.706326009" Jun 12 20:15:19.165282 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:19.165242 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:15:27.398945 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:27.398852 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:27.398945 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:27.398919 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:27.403478 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:27.403453 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:27.862995 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:27.862966 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:15:27.905884 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:27.905853 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:15:52.931955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:52.931917 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-56b655dfdf-qjkxn" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" containerID="cri-o://73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d" gracePeriod=15 Jun 12 20:15:53.198972 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.198948 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:15:53.269173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269146 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269293 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269191 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269293 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269230 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-594ht\" (UniqueName: \"kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269293 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269262 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269293 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269286 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269495 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269313 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269495 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269357 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config\") pod \"e1850dcf-1454-40f7-93d7-d10c0a114238\" (UID: \"e1850dcf-1454-40f7-93d7-d10c0a114238\") " Jun 12 20:15:53.269685 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269654 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config" (OuterVolumeSpecName: "console-config") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:53.269685 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269670 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca" (OuterVolumeSpecName: "service-ca") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:53.269872 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269706 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:53.269872 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.269731 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:15:53.271330 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.271302 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:53.271409 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.271369 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht" (OuterVolumeSpecName: "kube-api-access-594ht") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "kube-api-access-594ht". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:15:53.271409 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.271390 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e1850dcf-1454-40f7-93d7-d10c0a114238" (UID: "e1850dcf-1454-40f7-93d7-d10c0a114238"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:15:53.369866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369828 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-service-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.369866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369848 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-594ht\" (UniqueName: \"kubernetes.io/projected/e1850dcf-1454-40f7-93d7-d10c0a114238-kube-api-access-594ht\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.369866 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369859 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-console-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.370050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369872 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-oauth-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.370050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369880 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e1850dcf-1454-40f7-93d7-d10c0a114238-trusted-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.370050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369888 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-oauth-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.370050 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.369897 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e1850dcf-1454-40f7-93d7-d10c0a114238-console-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:15:53.962149 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.962062 2579 generic.go:356] "Generic (PLEG): container finished" podID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerID="73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d" exitCode=0 Jun 12 20:15:53.962149 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.962110 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-56b655dfdf-qjkxn" Jun 12 20:15:53.962149 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.962128 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b655dfdf-qjkxn" event={"ID":"e1850dcf-1454-40f7-93d7-d10c0a114238","Type":"ContainerDied","Data":"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d"} Jun 12 20:15:53.962659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.962169 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-56b655dfdf-qjkxn" event={"ID":"e1850dcf-1454-40f7-93d7-d10c0a114238","Type":"ContainerDied","Data":"b9be33338f25d345ad49eb935d8d8409cae37c72583622fa069d3d1cb0a87079"} Jun 12 20:15:53.962659 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.962189 2579 scope.go:117] "RemoveContainer" containerID="73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d" Jun 12 20:15:53.970189 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.970171 2579 scope.go:117] "RemoveContainer" containerID="73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d" Jun 12 20:15:53.970453 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:15:53.970436 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d\": container with ID starting with 73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d not found: ID does not exist" containerID="73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d" Jun 12 20:15:53.970522 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.970458 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d"} err="failed to get container status \"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d\": rpc error: code = NotFound desc = could not find container \"73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d\": container with ID starting with 73bda5e6331afcf105f485a78f656f00d5ca9d20c2106f519a967d90230b666d not found: ID does not exist" Jun 12 20:15:53.977993 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.977972 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:15:53.981680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:53.981660 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-56b655dfdf-qjkxn"] Jun 12 20:15:55.574253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:15:55.574210 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" path="/var/lib/kubelet/pods/e1850dcf-1454-40f7-93d7-d10c0a114238/volumes" Jun 12 20:16:14.165028 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:16:14.164994 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:16:14.180303 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:16:14.180282 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:16:15.056467 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:16:15.056442 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 20:17:22.096455 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.096422 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:17:22.096867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.096692 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" Jun 12 20:17:22.096867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.096702 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" Jun 12 20:17:22.096867 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.096768 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="e1850dcf-1454-40f7-93d7-d10c0a114238" containerName="console" Jun 12 20:17:22.099560 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.099535 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.109024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.108990 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:17:22.204894 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.204867 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rcnn5\" (UniqueName: \"kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205036 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.204905 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205036 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.204925 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205036 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.204939 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205195 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.205052 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205195 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.205090 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.205195 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.205121 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306059 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306033 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306172 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306068 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306172 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306123 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306175 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rcnn5\" (UniqueName: \"kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306212 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306248 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306287 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306273 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.306920 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.307023 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306916 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.307023 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.306894 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.307246 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.307225 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.308477 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.308449 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.308662 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.308645 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.314759 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.314738 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rcnn5\" (UniqueName: \"kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5\") pod \"console-7d8c748564-rsh72\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.408809 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.408737 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:22.535056 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:22.535030 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:17:22.537575 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:17:22.537551 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec88fadd_7614_4e10_8b22_4dd103cd00bb.slice/crio-ebd7a237cf08c2d40b453bddfd249fd91d052b7db9048633e00b972d765df1de WatchSource:0}: Error finding container ebd7a237cf08c2d40b453bddfd249fd91d052b7db9048633e00b972d765df1de: Status 404 returned error can't find the container with id ebd7a237cf08c2d40b453bddfd249fd91d052b7db9048633e00b972d765df1de Jun 12 20:17:23.296157 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:23.296115 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c748564-rsh72" event={"ID":"ec88fadd-7614-4e10-8b22-4dd103cd00bb","Type":"ContainerStarted","Data":"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6"} Jun 12 20:17:23.296545 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:23.296174 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c748564-rsh72" event={"ID":"ec88fadd-7614-4e10-8b22-4dd103cd00bb","Type":"ContainerStarted","Data":"ebd7a237cf08c2d40b453bddfd249fd91d052b7db9048633e00b972d765df1de"} Jun 12 20:17:23.314139 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:23.314094 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7d8c748564-rsh72" podStartSLOduration=1.314076301 podStartE2EDuration="1.314076301s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:17:23.312245722 +0000 UTC m=+462.182670969" watchObservedRunningTime="2026-06-12 20:17:23.314076301 +0000 UTC m=+462.184501547" Jun 12 20:17:32.409593 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:32.409540 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:32.410109 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:32.409616 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:32.414225 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:32.414205 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:33.336439 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:33.336412 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:17:33.380963 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:33.380930 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:17:58.400691 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.400653 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-85ffd854cc-jns9h" podUID="c99e628e-7ad1-4d0b-9a36-0804b036e774" containerName="console" containerID="cri-o://1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e" gracePeriod=15 Jun 12 20:17:58.636042 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.636015 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:17:58.786320 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786291 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786334 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786365 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786382 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jccgh\" (UniqueName: \"kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786422 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786448 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786470 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca\") pod \"c99e628e-7ad1-4d0b-9a36-0804b036e774\" (UID: \"c99e628e-7ad1-4d0b-9a36-0804b036e774\") " Jun 12 20:17:58.786853 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786771 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:17:58.786925 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786898 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:17:58.786925 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786911 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config" (OuterVolumeSpecName: "console-config") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:17:58.787030 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.786978 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca" (OuterVolumeSpecName: "service-ca") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:17:58.788451 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.788428 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:17:58.788555 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.788471 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh" (OuterVolumeSpecName: "kube-api-access-jccgh") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "kube-api-access-jccgh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:17:58.788555 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.788479 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c99e628e-7ad1-4d0b-9a36-0804b036e774" (UID: "c99e628e-7ad1-4d0b-9a36-0804b036e774"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:17:58.887743 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887722 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887743 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887741 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-oauth-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887751 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jccgh\" (UniqueName: \"kubernetes.io/projected/c99e628e-7ad1-4d0b-9a36-0804b036e774-kube-api-access-jccgh\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887760 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887768 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-trusted-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887776 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c99e628e-7ad1-4d0b-9a36-0804b036e774-service-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:58.887891 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:58.887784 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c99e628e-7ad1-4d0b-9a36-0804b036e774-console-oauth-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:17:59.428006 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.427973 2579 generic.go:356] "Generic (PLEG): container finished" podID="c99e628e-7ad1-4d0b-9a36-0804b036e774" containerID="1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e" exitCode=0 Jun 12 20:17:59.428434 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.428018 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-85ffd854cc-jns9h" Jun 12 20:17:59.428434 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.428032 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85ffd854cc-jns9h" event={"ID":"c99e628e-7ad1-4d0b-9a36-0804b036e774","Type":"ContainerDied","Data":"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e"} Jun 12 20:17:59.428434 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.428080 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-85ffd854cc-jns9h" event={"ID":"c99e628e-7ad1-4d0b-9a36-0804b036e774","Type":"ContainerDied","Data":"72cbfcb721c4bca7ac58228f6479840ece196b560690e4d20f37bc45fc2f1a1d"} Jun 12 20:17:59.428434 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.428109 2579 scope.go:117] "RemoveContainer" containerID="1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e" Jun 12 20:17:59.436326 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.436310 2579 scope.go:117] "RemoveContainer" containerID="1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e" Jun 12 20:17:59.436577 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:17:59.436562 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e\": container with ID starting with 1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e not found: ID does not exist" containerID="1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e" Jun 12 20:17:59.436626 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.436584 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e"} err="failed to get container status \"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e\": rpc error: code = NotFound desc = could not find container \"1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e\": container with ID starting with 1f72e455a8baf86bbaf140870f5b756f0d90e6763b982996ea615ea34cee9d4e not found: ID does not exist" Jun 12 20:17:59.448718 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.448697 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:17:59.454340 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.454321 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-85ffd854cc-jns9h"] Jun 12 20:17:59.574607 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:17:59.574574 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99e628e-7ad1-4d0b-9a36-0804b036e774" path="/var/lib/kubelet/pods/c99e628e-7ad1-4d0b-9a36-0804b036e774/volumes" Jun 12 20:18:45.944729 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.944692 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc"] Jun 12 20:18:45.945955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.945927 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99e628e-7ad1-4d0b-9a36-0804b036e774" containerName="console" Jun 12 20:18:45.946118 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.946106 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99e628e-7ad1-4d0b-9a36-0804b036e774" containerName="console" Jun 12 20:18:45.946371 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.946358 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99e628e-7ad1-4d0b-9a36-0804b036e774" containerName="console" Jun 12 20:18:45.951488 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.951460 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:45.956327 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.956296 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 20:18:45.956472 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.956352 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 20:18:45.956472 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.956423 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 20:18:45.956586 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.956424 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-chtxb\"" Jun 12 20:18:45.956851 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.956831 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 20:18:45.961468 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:45.961446 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc"] Jun 12 20:18:46.028428 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.028398 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.028550 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.028458 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.028550 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.028486 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.028550 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.028509 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4mxg\" (UniqueName: \"kubernetes.io/projected/9105eafc-08c3-4316-ac8c-72c7b795aef4-kube-api-access-z4mxg\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.028550 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.028528 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.129704 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.129679 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.129832 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.129719 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.129832 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.129743 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.129948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.129863 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4mxg\" (UniqueName: \"kubernetes.io/projected/9105eafc-08c3-4316-ac8c-72c7b795aef4-kube-api-access-z4mxg\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.129948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.129913 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.130110 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.130089 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-manifests\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.131988 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.131963 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9105eafc-08c3-4316-ac8c-72c7b795aef4-tmp\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.132203 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.132186 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-apiservice-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.132248 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.132205 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9105eafc-08c3-4316-ac8c-72c7b795aef4-webhook-cert\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.138785 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.138765 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4mxg\" (UniqueName: \"kubernetes.io/projected/9105eafc-08c3-4316-ac8c-72c7b795aef4-kube-api-access-z4mxg\") pod \"opendatahub-operator-controller-manager-68bb89b4d-nrtvc\" (UID: \"9105eafc-08c3-4316-ac8c-72c7b795aef4\") " pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.263357 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.263321 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:46.394462 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.394433 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc"] Jun 12 20:18:46.398137 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:18:46.398107 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9105eafc_08c3_4316_ac8c_72c7b795aef4.slice/crio-9280ff0344e0849ad3256aed90db71847ef6d8cea7fc9595dbb30b42756e16ff WatchSource:0}: Error finding container 9280ff0344e0849ad3256aed90db71847ef6d8cea7fc9595dbb30b42756e16ff: Status 404 returned error can't find the container with id 9280ff0344e0849ad3256aed90db71847ef6d8cea7fc9595dbb30b42756e16ff Jun 12 20:18:46.400536 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.400517 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:18:46.605610 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:46.605531 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" event={"ID":"9105eafc-08c3-4316-ac8c-72c7b795aef4","Type":"ContainerStarted","Data":"9280ff0344e0849ad3256aed90db71847ef6d8cea7fc9595dbb30b42756e16ff"} Jun 12 20:18:49.620848 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:49.620756 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" event={"ID":"9105eafc-08c3-4316-ac8c-72c7b795aef4","Type":"ContainerStarted","Data":"bb4d30c10a5466eae837b1a8c93547df357c12aa6128b7a2c512a22128afacf6"} Jun 12 20:18:50.625606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:50.625532 2579 generic.go:356] "Generic (PLEG): container finished" podID="9105eafc-08c3-4316-ac8c-72c7b795aef4" containerID="bb4d30c10a5466eae837b1a8c93547df357c12aa6128b7a2c512a22128afacf6" exitCode=0 Jun 12 20:18:50.625606 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:50.625597 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" event={"ID":"9105eafc-08c3-4316-ac8c-72c7b795aef4","Type":"ContainerDied","Data":"bb4d30c10a5466eae837b1a8c93547df357c12aa6128b7a2c512a22128afacf6"} Jun 12 20:18:51.630707 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:51.630674 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" event={"ID":"9105eafc-08c3-4316-ac8c-72c7b795aef4","Type":"ContainerStarted","Data":"8a5617f56930803f5383f410496d0218d326ae29832984138f0ab99542dc2919"} Jun 12 20:18:51.631111 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:51.630789 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:18:51.655809 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:18:51.655751 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" podStartSLOduration=2.339298801 podStartE2EDuration="6.655738939s" totalImagesPullingTime="3.348667054s" totalInitContainerRuntime="967.773084ms" isStatefulPod=false podCreationTimestamp="2026-06-12 20:18:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:18:51.653441316 +0000 UTC m=+550.523866598" watchObservedRunningTime="2026-06-12 20:18:51.655738939 +0000 UTC m=+550.526164183" Jun 12 20:19:02.637681 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:02.637648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-68bb89b4d-nrtvc" Jun 12 20:19:05.820854 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.820816 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr"] Jun 12 20:19:05.829452 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.829426 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:05.831961 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.831940 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 20:19:05.832123 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.831939 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 20:19:05.832310 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.832294 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 20:19:05.832933 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.832919 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ngkc9\"" Jun 12 20:19:05.832985 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.832942 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 20:19:05.838276 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.838252 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr"] Jun 12 20:19:05.984649 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.984623 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tls-certs\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:05.984824 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.984655 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dclxz\" (UniqueName: \"kubernetes.io/projected/1802efe4-85d9-43a7-b779-c9c8d8bbe868-kube-api-access-dclxz\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:05.984824 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:05.984765 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tmp\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.085994 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.085962 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tmp\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.086153 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.086012 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tls-certs\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.086153 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.086120 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dclxz\" (UniqueName: \"kubernetes.io/projected/1802efe4-85d9-43a7-b779-c9c8d8bbe868-kube-api-access-dclxz\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.088206 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.088179 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tmp\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.088420 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.088402 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1802efe4-85d9-43a7-b779-c9c8d8bbe868-tls-certs\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.094634 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.094611 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dclxz\" (UniqueName: \"kubernetes.io/projected/1802efe4-85d9-43a7-b779-c9c8d8bbe868-kube-api-access-dclxz\") pod \"kube-auth-proxy-7cb5559799-2jzbr\" (UID: \"1802efe4-85d9-43a7-b779-c9c8d8bbe868\") " pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.140895 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.140877 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" Jun 12 20:19:06.262127 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.262109 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr"] Jun 12 20:19:06.264409 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:19:06.264382 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1802efe4_85d9_43a7_b779_c9c8d8bbe868.slice/crio-91033f177b76317759d68f139fe48a3ac3f23c8e0231ec045021474c4e29251a WatchSource:0}: Error finding container 91033f177b76317759d68f139fe48a3ac3f23c8e0231ec045021474c4e29251a: Status 404 returned error can't find the container with id 91033f177b76317759d68f139fe48a3ac3f23c8e0231ec045021474c4e29251a Jun 12 20:19:06.695483 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:06.695408 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" event={"ID":"1802efe4-85d9-43a7-b779-c9c8d8bbe868","Type":"ContainerStarted","Data":"91033f177b76317759d68f139fe48a3ac3f23c8e0231ec045021474c4e29251a"} Jun 12 20:19:09.710521 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:09.710487 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" event={"ID":"1802efe4-85d9-43a7-b779-c9c8d8bbe868","Type":"ContainerStarted","Data":"44aadbd187bd5df24d290b87dd5711424ea40acf19c55490aa8a22dcbf7d1756"} Jun 12 20:19:09.727088 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:09.727044 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7cb5559799-2jzbr" podStartSLOduration=1.935421257 podStartE2EDuration="4.727029762s" totalImagesPullingTime="2.791608505s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:19:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:19:09.726775564 +0000 UTC m=+568.597200810" watchObservedRunningTime="2026-06-12 20:19:09.727029762 +0000 UTC m=+568.597455055" Jun 12 20:19:14.619875 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.619842 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq"] Jun 12 20:19:14.622281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.622264 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.626575 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.626556 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 20:19:14.627573 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.627542 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-swxbf\"" Jun 12 20:19:14.627722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.627579 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 20:19:14.627722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.627711 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 20:19:14.627722 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.627583 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 20:19:14.627970 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.627628 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 20:19:14.640754 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.640733 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq"] Jun 12 20:19:14.753683 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.753657 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.753835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.753688 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-metrics-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.753835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.753754 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1076377-dc25-4bca-ac67-53d9d24eccd7-manager-config\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.753835 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.753782 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gnnd4\" (UniqueName: \"kubernetes.io/projected/f1076377-dc25-4bca-ac67-53d9d24eccd7-kube-api-access-gnnd4\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.855084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.855052 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.855084 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.855085 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-metrics-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.855262 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.855138 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1076377-dc25-4bca-ac67-53d9d24eccd7-manager-config\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.855262 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.855186 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gnnd4\" (UniqueName: \"kubernetes.io/projected/f1076377-dc25-4bca-ac67-53d9d24eccd7-kube-api-access-gnnd4\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.856104 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.856059 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/f1076377-dc25-4bca-ac67-53d9d24eccd7-manager-config\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.858088 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.858039 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.858315 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.858277 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/f1076377-dc25-4bca-ac67-53d9d24eccd7-metrics-cert\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.878148 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.878083 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gnnd4\" (UniqueName: \"kubernetes.io/projected/f1076377-dc25-4bca-ac67-53d9d24eccd7-kube-api-access-gnnd4\") pod \"lws-controller-manager-546dccc465-8wzvq\" (UID: \"f1076377-dc25-4bca-ac67-53d9d24eccd7\") " pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:14.932130 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:14.932101 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:15.094496 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:15.094344 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq"] Jun 12 20:19:15.097080 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:19:15.097046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1076377_dc25_4bca_ac67_53d9d24eccd7.slice/crio-267b67ce54d0da1db2614ca3073cb3f7cd131b08e7a946e8880527ed60c08e48 WatchSource:0}: Error finding container 267b67ce54d0da1db2614ca3073cb3f7cd131b08e7a946e8880527ed60c08e48: Status 404 returned error can't find the container with id 267b67ce54d0da1db2614ca3073cb3f7cd131b08e7a946e8880527ed60c08e48 Jun 12 20:19:15.736267 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:15.736213 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" event={"ID":"f1076377-dc25-4bca-ac67-53d9d24eccd7","Type":"ContainerStarted","Data":"267b67ce54d0da1db2614ca3073cb3f7cd131b08e7a946e8880527ed60c08e48"} Jun 12 20:19:17.745728 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:17.745689 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" event={"ID":"f1076377-dc25-4bca-ac67-53d9d24eccd7","Type":"ContainerStarted","Data":"5ded4b17480245c9d83fa6f0bcd74313aea06fd49aaa0aa72d052897d3ca4d8d"} Jun 12 20:19:17.746142 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:17.745826 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:17.767156 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:17.767115 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" podStartSLOduration=1.5959712929999998 podStartE2EDuration="3.767102619s" totalImagesPullingTime="2.171131326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:19:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:19:17.766131641 +0000 UTC m=+576.636556906" watchObservedRunningTime="2026-06-12 20:19:17.767102619 +0000 UTC m=+576.637527863" Jun 12 20:19:28.752171 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:28.752141 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-546dccc465-8wzvq" Jun 12 20:19:41.556750 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:41.556715 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:19:41.557262 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:19:41.556900 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:20:22.566954 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.566922 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cf4b557dc-ml6zs"] Jun 12 20:20:22.570138 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.570114 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.582736 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.582711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf4b557dc-ml6zs"] Jun 12 20:20:22.660469 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660430 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-trusted-ca-bundle\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660469 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660474 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-oauth-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660497 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660545 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660589 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-service-ca\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660613 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-oauth-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.660632 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.660628 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sj6zz\" (UniqueName: \"kubernetes.io/projected/0d5892eb-5d50-4f20-88a7-8678c9344d47-kube-api-access-sj6zz\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761227 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761199 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-service-ca\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761237 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-oauth-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761255 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sj6zz\" (UniqueName: \"kubernetes.io/projected/0d5892eb-5d50-4f20-88a7-8678c9344d47-kube-api-access-sj6zz\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761276 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-trusted-ca-bundle\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761305 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-oauth-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761358 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761339 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.761638 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.761378 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.762128 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.762099 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-service-ca\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.762128 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.762122 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.762255 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.762157 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-oauth-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.762419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.762399 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/0d5892eb-5d50-4f20-88a7-8678c9344d47-trusted-ca-bundle\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.763777 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.763752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-oauth-config\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.763872 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.763752 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0d5892eb-5d50-4f20-88a7-8678c9344d47-console-serving-cert\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.769132 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.769110 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sj6zz\" (UniqueName: \"kubernetes.io/projected/0d5892eb-5d50-4f20-88a7-8678c9344d47-kube-api-access-sj6zz\") pod \"console-cf4b557dc-ml6zs\" (UID: \"0d5892eb-5d50-4f20-88a7-8678c9344d47\") " pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:22.880041 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:22.879989 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:23.008316 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:23.008288 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cf4b557dc-ml6zs"] Jun 12 20:20:23.010769 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:20:23.010741 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0d5892eb_5d50_4f20_88a7_8678c9344d47.slice/crio-b014c4189bd9a6b4ab0ab0d190b27ea6697db2e98d2de9f99649eac236c80dc2 WatchSource:0}: Error finding container b014c4189bd9a6b4ab0ab0d190b27ea6697db2e98d2de9f99649eac236c80dc2: Status 404 returned error can't find the container with id b014c4189bd9a6b4ab0ab0d190b27ea6697db2e98d2de9f99649eac236c80dc2 Jun 12 20:20:24.019644 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:24.019609 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf4b557dc-ml6zs" event={"ID":"0d5892eb-5d50-4f20-88a7-8678c9344d47","Type":"ContainerStarted","Data":"c517a684e8b9ae71f6fdaf3c1dc4a78fd342261e86f95341dadb2f602680f349"} Jun 12 20:20:24.020022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:24.019657 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cf4b557dc-ml6zs" event={"ID":"0d5892eb-5d50-4f20-88a7-8678c9344d47","Type":"ContainerStarted","Data":"b014c4189bd9a6b4ab0ab0d190b27ea6697db2e98d2de9f99649eac236c80dc2"} Jun 12 20:20:24.037554 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:24.037502 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cf4b557dc-ml6zs" podStartSLOduration=2.037489227 podStartE2EDuration="2.037489227s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:24.036739353 +0000 UTC m=+642.907164625" watchObservedRunningTime="2026-06-12 20:20:24.037489227 +0000 UTC m=+642.907914472" Jun 12 20:20:32.880441 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:32.880409 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:32.880852 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:32.880461 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:32.884921 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:32.884899 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:33.061961 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:33.061933 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cf4b557dc-ml6zs" Jun 12 20:20:33.113479 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:33.113447 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:20:44.930085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.930050 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd"] Jun 12 20:20:44.936645 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.935830 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:44.939887 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.939861 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 20:20:44.940137 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.940114 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 20:20:44.940967 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.940949 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-wvs9p\"" Jun 12 20:20:44.948954 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:44.948934 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd"] Jun 12 20:20:45.025613 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:45.025575 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrs65\" (UniqueName: \"kubernetes.io/projected/c70e4c52-d07e-4a95-b2f3-ae75c00c6532-kube-api-access-jrs65\") pod \"authorino-operator-75cc8d5cb7-m2qqd\" (UID: \"c70e4c52-d07e-4a95-b2f3-ae75c00c6532\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:45.126254 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:45.126221 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrs65\" (UniqueName: \"kubernetes.io/projected/c70e4c52-d07e-4a95-b2f3-ae75c00c6532-kube-api-access-jrs65\") pod \"authorino-operator-75cc8d5cb7-m2qqd\" (UID: \"c70e4c52-d07e-4a95-b2f3-ae75c00c6532\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:45.134273 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:45.134249 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrs65\" (UniqueName: \"kubernetes.io/projected/c70e4c52-d07e-4a95-b2f3-ae75c00c6532-kube-api-access-jrs65\") pod \"authorino-operator-75cc8d5cb7-m2qqd\" (UID: \"c70e4c52-d07e-4a95-b2f3-ae75c00c6532\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:45.247849 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:45.247822 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:45.381054 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:45.381023 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd"] Jun 12 20:20:45.384284 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:20:45.384260 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc70e4c52_d07e_4a95_b2f3_ae75c00c6532.slice/crio-6423d1a8b9dfdc9f9339b7ca8fcc9d4226d0693260d7d478a7975da3b74c85c7 WatchSource:0}: Error finding container 6423d1a8b9dfdc9f9339b7ca8fcc9d4226d0693260d7d478a7975da3b74c85c7: Status 404 returned error can't find the container with id 6423d1a8b9dfdc9f9339b7ca8fcc9d4226d0693260d7d478a7975da3b74c85c7 Jun 12 20:20:46.124908 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:46.124809 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" event={"ID":"c70e4c52-d07e-4a95-b2f3-ae75c00c6532","Type":"ContainerStarted","Data":"6423d1a8b9dfdc9f9339b7ca8fcc9d4226d0693260d7d478a7975da3b74c85c7"} Jun 12 20:20:48.134605 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:48.134573 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" event={"ID":"c70e4c52-d07e-4a95-b2f3-ae75c00c6532","Type":"ContainerStarted","Data":"f2dc83d9636374ed5d97e37a1cdaa3c8e23ed61d9ff42bf985f1c6f2af24c719"} Jun 12 20:20:48.135032 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:48.134648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:48.154004 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:48.153954 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" podStartSLOduration=2.083907549 podStartE2EDuration="4.153940718s" totalImagesPullingTime="2.070033169s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:20:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:20:48.153542973 +0000 UTC m=+667.023968218" watchObservedRunningTime="2026-06-12 20:20:48.153940718 +0000 UTC m=+667.024365962" Jun 12 20:20:58.132763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.132720 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7d8c748564-rsh72" podUID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" containerName="console" containerID="cri-o://0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6" gracePeriod=15 Jun 12 20:20:58.374473 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.374447 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:20:58.426944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.426886 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.426944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.426917 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.426944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.426935 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.427181 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.426952 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.427181 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427014 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.427181 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427031 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.427181 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427049 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rcnn5\" (UniqueName: \"kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5\") pod \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\" (UID: \"ec88fadd-7614-4e10-8b22-4dd103cd00bb\") " Jun 12 20:20:58.427466 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427419 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca" (OuterVolumeSpecName: "service-ca") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:20:58.427596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427539 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:20:58.427596 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427562 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config" (OuterVolumeSpecName: "console-config") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:20:58.427715 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.427598 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:20:58.429044 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.429024 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:20:58.429112 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.429042 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:20:58.429171 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.429150 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5" (OuterVolumeSpecName: "kube-api-access-rcnn5") pod "ec88fadd-7614-4e10-8b22-4dd103cd00bb" (UID: "ec88fadd-7614-4e10-8b22-4dd103cd00bb"). InnerVolumeSpecName "kube-api-access-rcnn5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:20:58.528433 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528408 2579 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-oauth-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528433 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528430 2579 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528440 2579 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-service-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528449 2579 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-oauth-serving-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528457 2579 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-console-config\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528465 2579 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ec88fadd-7614-4e10-8b22-4dd103cd00bb-trusted-ca-bundle\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:58.528565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:58.528473 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rcnn5\" (UniqueName: \"kubernetes.io/projected/ec88fadd-7614-4e10-8b22-4dd103cd00bb-kube-api-access-rcnn5\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:20:59.140992 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.140962 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-m2qqd" Jun 12 20:20:59.191199 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.191166 2579 generic.go:356] "Generic (PLEG): container finished" podID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" containerID="0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6" exitCode=0 Jun 12 20:20:59.191339 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.191214 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7d8c748564-rsh72" Jun 12 20:20:59.191339 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.191247 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c748564-rsh72" event={"ID":"ec88fadd-7614-4e10-8b22-4dd103cd00bb","Type":"ContainerDied","Data":"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6"} Jun 12 20:20:59.191339 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.191298 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7d8c748564-rsh72" event={"ID":"ec88fadd-7614-4e10-8b22-4dd103cd00bb","Type":"ContainerDied","Data":"ebd7a237cf08c2d40b453bddfd249fd91d052b7db9048633e00b972d765df1de"} Jun 12 20:20:59.191339 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.191321 2579 scope.go:117] "RemoveContainer" containerID="0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6" Jun 12 20:20:59.199712 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.199691 2579 scope.go:117] "RemoveContainer" containerID="0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6" Jun 12 20:20:59.200000 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:20:59.199983 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6\": container with ID starting with 0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6 not found: ID does not exist" containerID="0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6" Jun 12 20:20:59.200079 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.200010 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6"} err="failed to get container status \"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6\": rpc error: code = NotFound desc = could not find container \"0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6\": container with ID starting with 0bc5b3b3f9f9ad22ac8332e1375c78d53529c50fd89c7862a5e9a64decd4d8b6 not found: ID does not exist" Jun 12 20:20:59.213068 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.213047 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:20:59.216383 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.216364 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7d8c748564-rsh72"] Jun 12 20:20:59.574590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:20:59.574560 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" path="/var/lib/kubelet/pods/ec88fadd-7614-4e10-8b22-4dd103cd00bb/volumes" Jun 12 20:21:55.642073 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.642040 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:21:55.642524 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.642327 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" containerName="console" Jun 12 20:21:55.642524 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.642338 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" containerName="console" Jun 12 20:21:55.642524 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.642400 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec88fadd-7614-4e10-8b22-4dd103cd00bb" containerName="console" Jun 12 20:21:55.645283 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.645266 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.647829 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.647774 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rwn6j\"" Jun 12 20:21:55.647956 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.647830 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 20:21:55.654544 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.654521 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:21:55.681395 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.681371 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:21:55.741806 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.741777 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b5jl\" (UniqueName: \"kubernetes.io/projected/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-kube-api-access-9b5jl\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.741949 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.741931 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-config-file\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.842465 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.842422 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-config-file\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.842584 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.842480 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b5jl\" (UniqueName: \"kubernetes.io/projected/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-kube-api-access-9b5jl\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.843089 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.843072 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-config-file\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.850558 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.850535 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b5jl\" (UniqueName: \"kubernetes.io/projected/e2fc5db9-b87e-49fd-86e5-08b85eb3aaca-kube-api-access-9b5jl\") pod \"limitador-limitador-54d6d988d5-77wks\" (UID: \"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:55.956892 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:55.956829 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:21:56.087775 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.087579 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:21:56.089934 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:21:56.089906 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode2fc5db9_b87e_49fd_86e5_08b85eb3aaca.slice/crio-d7e93cfa2e474a75c86ddb40785a80404f05ca7fe3d6d88697099d95bd71849b WatchSource:0}: Error finding container d7e93cfa2e474a75c86ddb40785a80404f05ca7fe3d6d88697099d95bd71849b: Status 404 returned error can't find the container with id d7e93cfa2e474a75c86ddb40785a80404f05ca7fe3d6d88697099d95bd71849b Jun 12 20:21:56.162106 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.162082 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:21:56.167661 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.167635 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:21:56.170174 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.170149 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-98pb2\"" Jun 12 20:21:56.171902 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.171869 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:21:56.347194 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.347166 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fstx8\" (UniqueName: \"kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8\") pod \"authorino-75d556bd77-5q5fq\" (UID: \"94c9f1d7-5105-4889-992c-e7313c6866f6\") " pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:21:56.439193 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.439113 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" event={"ID":"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca","Type":"ContainerStarted","Data":"d7e93cfa2e474a75c86ddb40785a80404f05ca7fe3d6d88697099d95bd71849b"} Jun 12 20:21:56.448327 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.448297 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fstx8\" (UniqueName: \"kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8\") pod \"authorino-75d556bd77-5q5fq\" (UID: \"94c9f1d7-5105-4889-992c-e7313c6866f6\") " pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:21:56.457303 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.457281 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fstx8\" (UniqueName: \"kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8\") pod \"authorino-75d556bd77-5q5fq\" (UID: \"94c9f1d7-5105-4889-992c-e7313c6866f6\") " pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:21:56.479085 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.479055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:21:56.659614 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:56.659472 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:21:56.665316 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:21:56.665281 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94c9f1d7_5105_4889_992c_e7313c6866f6.slice/crio-97203f64a1138218c5ac39d93eb795504a203241c016fc5cf8306367ba4acbd4 WatchSource:0}: Error finding container 97203f64a1138218c5ac39d93eb795504a203241c016fc5cf8306367ba4acbd4: Status 404 returned error can't find the container with id 97203f64a1138218c5ac39d93eb795504a203241c016fc5cf8306367ba4acbd4 Jun 12 20:21:57.445893 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:21:57.445843 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5q5fq" event={"ID":"94c9f1d7-5105-4889-992c-e7313c6866f6","Type":"ContainerStarted","Data":"97203f64a1138218c5ac39d93eb795504a203241c016fc5cf8306367ba4acbd4"} Jun 12 20:22:00.462369 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:00.462337 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" event={"ID":"e2fc5db9-b87e-49fd-86e5-08b85eb3aaca","Type":"ContainerStarted","Data":"d9e591a4a3ce24b66adf00c0d7ebe18196b24fac6ef7af0a354a20da0c6560c6"} Jun 12 20:22:00.462733 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:00.462466 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:22:00.463821 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:00.463779 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5q5fq" event={"ID":"94c9f1d7-5105-4889-992c-e7313c6866f6","Type":"ContainerStarted","Data":"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678"} Jun 12 20:22:00.477547 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:00.477508 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" podStartSLOduration=1.1986643080000001 podStartE2EDuration="5.477490571s" totalImagesPullingTime="4.278826263s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:22:00.476820214 +0000 UTC m=+739.347245454" watchObservedRunningTime="2026-06-12 20:22:00.477490571 +0000 UTC m=+739.347915816" Jun 12 20:22:00.492542 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:00.492492 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-5q5fq" podStartSLOduration=0.784275938 podStartE2EDuration="4.492479238s" totalImagesPullingTime="3.7082033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:21:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:22:00.490999516 +0000 UTC m=+739.361424764" watchObservedRunningTime="2026-06-12 20:22:00.492479238 +0000 UTC m=+739.362904482" Jun 12 20:22:11.470070 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:22:11.470035 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-77wks" Jun 12 20:23:21.331362 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.331330 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:21.333350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.333334 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:21.341133 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.341106 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:21.390934 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.390909 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j8ds\" (UniqueName: \"kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds\") pod \"authorino-5d4b67c446-rsp4l\" (UID: \"f796971e-7ac5-4d0c-b249-199af89c9121\") " pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:21.492024 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.491996 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j8ds\" (UniqueName: \"kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds\") pod \"authorino-5d4b67c446-rsp4l\" (UID: \"f796971e-7ac5-4d0c-b249-199af89c9121\") " pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:21.500588 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.500563 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j8ds\" (UniqueName: \"kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds\") pod \"authorino-5d4b67c446-rsp4l\" (UID: \"f796971e-7ac5-4d0c-b249-199af89c9121\") " pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:21.574996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.574974 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:21.575197 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.575187 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:21.606555 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.606529 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:21.608747 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.608727 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:21.617575 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.617551 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:21.694180 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.694152 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbpnm\" (UniqueName: \"kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm\") pod \"authorino-56dd977768-dcs27\" (UID: \"b0ab362c-c28b-45f8-8ec1-fcf740486c82\") " pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:21.703732 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.703708 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:21.706413 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:23:21.706390 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf796971e_7ac5_4d0c_b249_199af89c9121.slice/crio-2b093e7a27539788ce7f604b1314784e9f34690afc6d36edc1af05523bdbac3f WatchSource:0}: Error finding container 2b093e7a27539788ce7f604b1314784e9f34690afc6d36edc1af05523bdbac3f: Status 404 returned error can't find the container with id 2b093e7a27539788ce7f604b1314784e9f34690afc6d36edc1af05523bdbac3f Jun 12 20:23:21.794658 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.794633 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbpnm\" (UniqueName: \"kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm\") pod \"authorino-56dd977768-dcs27\" (UID: \"b0ab362c-c28b-45f8-8ec1-fcf740486c82\") " pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:21.804698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.804676 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbpnm\" (UniqueName: \"kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm\") pod \"authorino-56dd977768-dcs27\" (UID: \"b0ab362c-c28b-45f8-8ec1-fcf740486c82\") " pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:21.809039 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.809017 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" event={"ID":"f796971e-7ac5-4d0c-b249-199af89c9121","Type":"ContainerStarted","Data":"2b093e7a27539788ce7f604b1314784e9f34690afc6d36edc1af05523bdbac3f"} Jun 12 20:23:21.919260 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:21.919207 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:22.044302 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.044269 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:22.046123 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:23:22.046094 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb0ab362c_c28b_45f8_8ec1_fcf740486c82.slice/crio-8af5dc143025ca6e84a54a90135b0a9fb79dee57bd41a67729c84fe0b3b2c280 WatchSource:0}: Error finding container 8af5dc143025ca6e84a54a90135b0a9fb79dee57bd41a67729c84fe0b3b2c280: Status 404 returned error can't find the container with id 8af5dc143025ca6e84a54a90135b0a9fb79dee57bd41a67729c84fe0b3b2c280 Jun 12 20:23:22.184486 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.184401 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:22.213058 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.213028 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:23:22.215099 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.215076 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.217712 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.217688 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jun 12 20:23:22.226227 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.226206 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:23:22.297432 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.297406 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mb2mg\" (UniqueName: \"kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.297534 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.297449 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.398700 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.398677 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.399007 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.398742 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mb2mg\" (UniqueName: \"kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.400852 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.400834 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.408134 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.408111 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mb2mg\" (UniqueName: \"kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg\") pod \"authorino-5f5c99b584-vmgfx\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.524201 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.524166 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:23:22.657635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.657499 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:23:22.660029 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:23:22.659993 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfc357601_7eec_4564_a4f6_52914e5a6c5b.slice/crio-dfc88bd3ecf5dd11e4b29411e64ba72d7f9cf9268d0541d280f3ffe2df1e2de0 WatchSource:0}: Error finding container dfc88bd3ecf5dd11e4b29411e64ba72d7f9cf9268d0541d280f3ffe2df1e2de0: Status 404 returned error can't find the container with id dfc88bd3ecf5dd11e4b29411e64ba72d7f9cf9268d0541d280f3ffe2df1e2de0 Jun 12 20:23:22.814351 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.814267 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dd977768-dcs27" event={"ID":"b0ab362c-c28b-45f8-8ec1-fcf740486c82","Type":"ContainerStarted","Data":"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b"} Jun 12 20:23:22.814351 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.814317 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dd977768-dcs27" event={"ID":"b0ab362c-c28b-45f8-8ec1-fcf740486c82","Type":"ContainerStarted","Data":"8af5dc143025ca6e84a54a90135b0a9fb79dee57bd41a67729c84fe0b3b2c280"} Jun 12 20:23:22.814351 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.814328 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-56dd977768-dcs27" podUID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" containerName="authorino" containerID="cri-o://0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b" gracePeriod=30 Jun 12 20:23:22.815773 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.815746 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" event={"ID":"f796971e-7ac5-4d0c-b249-199af89c9121","Type":"ContainerStarted","Data":"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3"} Jun 12 20:23:22.815900 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.815781 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" podUID="f796971e-7ac5-4d0c-b249-199af89c9121" containerName="authorino" containerID="cri-o://854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3" gracePeriod=30 Jun 12 20:23:22.817173 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.817147 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" event={"ID":"fc357601-7eec-4564-a4f6-52914e5a6c5b","Type":"ContainerStarted","Data":"dfc88bd3ecf5dd11e4b29411e64ba72d7f9cf9268d0541d280f3ffe2df1e2de0"} Jun 12 20:23:22.836510 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.836468 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-56dd977768-dcs27" podStartSLOduration=1.531928636 podStartE2EDuration="1.836453954s" totalImagesPullingTime="304.525318ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:23:22.8359571 +0000 UTC m=+821.706382345" watchObservedRunningTime="2026-06-12 20:23:22.836453954 +0000 UTC m=+821.706879199" Jun 12 20:23:22.870714 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:22.870675 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" podStartSLOduration=1.5737856030000001 podStartE2EDuration="1.870664009s" totalImagesPullingTime="296.878406ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:23:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:23:22.867526102 +0000 UTC m=+821.737951344" watchObservedRunningTime="2026-06-12 20:23:22.870664009 +0000 UTC m=+821.741089255" Jun 12 20:23:23.069199 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.069151 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:23.080389 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.080369 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:23.103500 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.103462 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbpnm\" (UniqueName: \"kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm\") pod \"b0ab362c-c28b-45f8-8ec1-fcf740486c82\" (UID: \"b0ab362c-c28b-45f8-8ec1-fcf740486c82\") " Jun 12 20:23:23.103680 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.103566 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8j8ds\" (UniqueName: \"kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds\") pod \"f796971e-7ac5-4d0c-b249-199af89c9121\" (UID: \"f796971e-7ac5-4d0c-b249-199af89c9121\") " Jun 12 20:23:23.106097 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.106037 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm" (OuterVolumeSpecName: "kube-api-access-mbpnm") pod "b0ab362c-c28b-45f8-8ec1-fcf740486c82" (UID: "b0ab362c-c28b-45f8-8ec1-fcf740486c82"). InnerVolumeSpecName "kube-api-access-mbpnm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:23:23.106097 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.106079 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds" (OuterVolumeSpecName: "kube-api-access-8j8ds") pod "f796971e-7ac5-4d0c-b249-199af89c9121" (UID: "f796971e-7ac5-4d0c-b249-199af89c9121"). InnerVolumeSpecName "kube-api-access-8j8ds". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:23:23.204483 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.204451 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbpnm\" (UniqueName: \"kubernetes.io/projected/b0ab362c-c28b-45f8-8ec1-fcf740486c82-kube-api-access-mbpnm\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:23:23.204483 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.204479 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8j8ds\" (UniqueName: \"kubernetes.io/projected/f796971e-7ac5-4d0c-b249-199af89c9121-kube-api-access-8j8ds\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:23:23.822458 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.822371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" event={"ID":"fc357601-7eec-4564-a4f6-52914e5a6c5b","Type":"ContainerStarted","Data":"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99"} Jun 12 20:23:23.823641 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.823621 2579 generic.go:356] "Generic (PLEG): container finished" podID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" containerID="0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b" exitCode=0 Jun 12 20:23:23.823742 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.823657 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-56dd977768-dcs27" Jun 12 20:23:23.823742 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.823693 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dd977768-dcs27" event={"ID":"b0ab362c-c28b-45f8-8ec1-fcf740486c82","Type":"ContainerDied","Data":"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b"} Jun 12 20:23:23.823742 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.823726 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-56dd977768-dcs27" event={"ID":"b0ab362c-c28b-45f8-8ec1-fcf740486c82","Type":"ContainerDied","Data":"8af5dc143025ca6e84a54a90135b0a9fb79dee57bd41a67729c84fe0b3b2c280"} Jun 12 20:23:23.823911 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.823746 2579 scope.go:117] "RemoveContainer" containerID="0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b" Jun 12 20:23:23.825043 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.825019 2579 generic.go:356] "Generic (PLEG): container finished" podID="f796971e-7ac5-4d0c-b249-199af89c9121" containerID="854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3" exitCode=0 Jun 12 20:23:23.825144 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.825059 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" Jun 12 20:23:23.825203 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.825060 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" event={"ID":"f796971e-7ac5-4d0c-b249-199af89c9121","Type":"ContainerDied","Data":"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3"} Jun 12 20:23:23.825253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.825204 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-rsp4l" event={"ID":"f796971e-7ac5-4d0c-b249-199af89c9121","Type":"ContainerDied","Data":"2b093e7a27539788ce7f604b1314784e9f34690afc6d36edc1af05523bdbac3f"} Jun 12 20:23:23.831635 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.831616 2579 scope.go:117] "RemoveContainer" containerID="0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b" Jun 12 20:23:23.831893 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:23:23.831875 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b\": container with ID starting with 0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b not found: ID does not exist" containerID="0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b" Jun 12 20:23:23.831955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.831899 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b"} err="failed to get container status \"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b\": rpc error: code = NotFound desc = could not find container \"0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b\": container with ID starting with 0fec12ff3a8ee4c16898e051493222de7125628cfbed94bbf82c5989826bfe9b not found: ID does not exist" Jun 12 20:23:23.831955 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.831915 2579 scope.go:117] "RemoveContainer" containerID="854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3" Jun 12 20:23:23.839014 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.838996 2579 scope.go:117] "RemoveContainer" containerID="854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3" Jun 12 20:23:23.839187 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.839146 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" podStartSLOduration=1.503114665 podStartE2EDuration="1.839132394s" totalImagesPullingTime="336.017729ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:23:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:23:23.838020301 +0000 UTC m=+822.708445546" watchObservedRunningTime="2026-06-12 20:23:23.839132394 +0000 UTC m=+822.709557639" Jun 12 20:23:23.839311 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:23:23.839234 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3\": container with ID starting with 854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3 not found: ID does not exist" containerID="854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3" Jun 12 20:23:23.839311 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.839261 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3"} err="failed to get container status \"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3\": rpc error: code = NotFound desc = could not find container \"854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3\": container with ID starting with 854dd20e5b57bcfd3836806053956fa181b386f34ec72a993ef38b9227c466c3 not found: ID does not exist" Jun 12 20:23:23.854041 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.854017 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:23.857933 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.857913 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-rsp4l"] Jun 12 20:23:23.871076 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.871051 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:23:23.871223 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.871205 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-5q5fq" podUID="94c9f1d7-5105-4889-992c-e7313c6866f6" containerName="authorino" containerID="cri-o://6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678" gracePeriod=30 Jun 12 20:23:23.875485 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.875461 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:23.882971 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:23.882948 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-56dd977768-dcs27"] Jun 12 20:23:24.119218 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.119194 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:23:24.213597 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.213574 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fstx8\" (UniqueName: \"kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8\") pod \"94c9f1d7-5105-4889-992c-e7313c6866f6\" (UID: \"94c9f1d7-5105-4889-992c-e7313c6866f6\") " Jun 12 20:23:24.215317 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.215295 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8" (OuterVolumeSpecName: "kube-api-access-fstx8") pod "94c9f1d7-5105-4889-992c-e7313c6866f6" (UID: "94c9f1d7-5105-4889-992c-e7313c6866f6"). InnerVolumeSpecName "kube-api-access-fstx8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:23:24.314645 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.314618 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fstx8\" (UniqueName: \"kubernetes.io/projected/94c9f1d7-5105-4889-992c-e7313c6866f6-kube-api-access-fstx8\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:23:24.831962 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.831932 2579 generic.go:356] "Generic (PLEG): container finished" podID="94c9f1d7-5105-4889-992c-e7313c6866f6" containerID="6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678" exitCode=0 Jun 12 20:23:24.832418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.831968 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-5q5fq" Jun 12 20:23:24.832418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.832010 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5q5fq" event={"ID":"94c9f1d7-5105-4889-992c-e7313c6866f6","Type":"ContainerDied","Data":"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678"} Jun 12 20:23:24.832418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.832038 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-5q5fq" event={"ID":"94c9f1d7-5105-4889-992c-e7313c6866f6","Type":"ContainerDied","Data":"97203f64a1138218c5ac39d93eb795504a203241c016fc5cf8306367ba4acbd4"} Jun 12 20:23:24.832418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.832059 2579 scope.go:117] "RemoveContainer" containerID="6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678" Jun 12 20:23:24.840950 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.840934 2579 scope.go:117] "RemoveContainer" containerID="6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678" Jun 12 20:23:24.841202 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:23:24.841185 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678\": container with ID starting with 6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678 not found: ID does not exist" containerID="6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678" Jun 12 20:23:24.841254 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.841209 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678"} err="failed to get container status \"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678\": rpc error: code = NotFound desc = could not find container \"6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678\": container with ID starting with 6d8bdb22870941eedb7974afb625afc62ecc255160464a527a2ed4d948772678 not found: ID does not exist" Jun 12 20:23:24.854222 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.854199 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:23:24.862873 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:24.862855 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-5q5fq"] Jun 12 20:23:25.575760 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:25.575727 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="94c9f1d7-5105-4889-992c-e7313c6866f6" path="/var/lib/kubelet/pods/94c9f1d7-5105-4889-992c-e7313c6866f6/volumes" Jun 12 20:23:25.576058 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:25.576045 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" path="/var/lib/kubelet/pods/b0ab362c-c28b-45f8-8ec1-fcf740486c82/volumes" Jun 12 20:23:25.576321 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:23:25.576310 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f796971e-7ac5-4d0c-b249-199af89c9121" path="/var/lib/kubelet/pods/f796971e-7ac5-4d0c-b249-199af89c9121/volumes" Jun 12 20:24:02.561471 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:02.561439 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:24:41.584394 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:41.584366 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:24:41.585097 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:41.585081 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:24:51.575067 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575037 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575357 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="94c9f1d7-5105-4889-992c-e7313c6866f6" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575369 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="94c9f1d7-5105-4889-992c-e7313c6866f6" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575384 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575390 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575403 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f796971e-7ac5-4d0c-b249-199af89c9121" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575409 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="f796971e-7ac5-4d0c-b249-199af89c9121" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575455 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="94c9f1d7-5105-4889-992c-e7313c6866f6" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575460 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ab362c-c28b-45f8-8ec1-fcf740486c82" containerName="authorino" Jun 12 20:24:51.575668 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.575467 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="f796971e-7ac5-4d0c-b249-199af89c9121" containerName="authorino" Jun 12 20:24:51.578519 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.578496 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.579956 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.579930 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:24:51.580818 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.580778 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"authorino-oidc-ca\"" Jun 12 20:24:51.694064 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.694039 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.694191 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.694077 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.694262 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.694220 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9v2v2\" (UniqueName: \"kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.794837 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.794814 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9v2v2\" (UniqueName: \"kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.794948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.794852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.794948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.794877 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.795417 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.795400 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.797231 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.797212 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.805774 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.805746 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9v2v2\" (UniqueName: \"kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2\") pod \"authorino-78857b776b-k89cw\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:51.888236 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:51.888179 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:24:52.009833 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:52.009786 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:24:52.012264 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:24:52.012238 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod72493120_14bc_4fe9_864f_3387ed7fb5dc.slice/crio-4d47c8bfdf82ca7313ec6e0f449a2204d41b7b5948205dc6ad124b3541dfdf4f WatchSource:0}: Error finding container 4d47c8bfdf82ca7313ec6e0f449a2204d41b7b5948205dc6ad124b3541dfdf4f: Status 404 returned error can't find the container with id 4d47c8bfdf82ca7313ec6e0f449a2204d41b7b5948205dc6ad124b3541dfdf4f Jun 12 20:24:52.013590 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:52.013572 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:24:52.215958 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:52.215888 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78857b776b-k89cw" event={"ID":"72493120-14bc-4fe9-864f-3387ed7fb5dc","Type":"ContainerStarted","Data":"4d47c8bfdf82ca7313ec6e0f449a2204d41b7b5948205dc6ad124b3541dfdf4f"} Jun 12 20:24:53.223750 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.223719 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78857b776b-k89cw" event={"ID":"72493120-14bc-4fe9-864f-3387ed7fb5dc","Type":"ContainerStarted","Data":"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7"} Jun 12 20:24:53.240350 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.240305 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-78857b776b-k89cw" podStartSLOduration=1.746079215 podStartE2EDuration="2.240290903s" totalImagesPullingTime="494.211688ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:24:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:24:53.238866118 +0000 UTC m=+912.109291365" watchObservedRunningTime="2026-06-12 20:24:53.240290903 +0000 UTC m=+912.110716148" Jun 12 20:24:53.268782 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.268748 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:24:53.269010 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.268986 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" podUID="fc357601-7eec-4564-a4f6-52914e5a6c5b" containerName="authorino" containerID="cri-o://bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99" gracePeriod=30 Jun 12 20:24:53.507328 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.507303 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:24:53.612544 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.612514 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert\") pod \"fc357601-7eec-4564-a4f6-52914e5a6c5b\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " Jun 12 20:24:53.612682 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.612574 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mb2mg\" (UniqueName: \"kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg\") pod \"fc357601-7eec-4564-a4f6-52914e5a6c5b\" (UID: \"fc357601-7eec-4564-a4f6-52914e5a6c5b\") " Jun 12 20:24:53.614598 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.614572 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg" (OuterVolumeSpecName: "kube-api-access-mb2mg") pod "fc357601-7eec-4564-a4f6-52914e5a6c5b" (UID: "fc357601-7eec-4564-a4f6-52914e5a6c5b"). InnerVolumeSpecName "kube-api-access-mb2mg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:24:53.621907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.621884 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "fc357601-7eec-4564-a4f6-52914e5a6c5b" (UID: "fc357601-7eec-4564-a4f6-52914e5a6c5b"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:24:53.713662 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.713636 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/fc357601-7eec-4564-a4f6-52914e5a6c5b-tls-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:24:53.713662 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:53.713659 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mb2mg\" (UniqueName: \"kubernetes.io/projected/fc357601-7eec-4564-a4f6-52914e5a6c5b-kube-api-access-mb2mg\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:24:54.228595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.228517 2579 generic.go:356] "Generic (PLEG): container finished" podID="fc357601-7eec-4564-a4f6-52914e5a6c5b" containerID="bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99" exitCode=0 Jun 12 20:24:54.228595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.228562 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" Jun 12 20:24:54.228595 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.228572 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" event={"ID":"fc357601-7eec-4564-a4f6-52914e5a6c5b","Type":"ContainerDied","Data":"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99"} Jun 12 20:24:54.229080 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.228619 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f5c99b584-vmgfx" event={"ID":"fc357601-7eec-4564-a4f6-52914e5a6c5b","Type":"ContainerDied","Data":"dfc88bd3ecf5dd11e4b29411e64ba72d7f9cf9268d0541d280f3ffe2df1e2de0"} Jun 12 20:24:54.229080 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.228643 2579 scope.go:117] "RemoveContainer" containerID="bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99" Jun 12 20:24:54.236890 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.236874 2579 scope.go:117] "RemoveContainer" containerID="bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99" Jun 12 20:24:54.237154 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:24:54.237135 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99\": container with ID starting with bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99 not found: ID does not exist" containerID="bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99" Jun 12 20:24:54.237202 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.237162 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99"} err="failed to get container status \"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99\": rpc error: code = NotFound desc = could not find container \"bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99\": container with ID starting with bc9da93238ddc89dce4f2106db9b96a26d2863f89b0c4ff0eb884155e1e2fc99 not found: ID does not exist" Jun 12 20:24:54.248297 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.248274 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:24:54.251948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:54.251928 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5f5c99b584-vmgfx"] Jun 12 20:24:55.574766 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:55.574733 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc357601-7eec-4564-a4f6-52914e5a6c5b" path="/var/lib/kubelet/pods/fc357601-7eec-4564-a4f6-52914e5a6c5b/volumes" Jun 12 20:24:58.665076 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:24:58.665039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:11.746103 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.746071 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg"] Jun 12 20:25:11.746602 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.746578 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc357601-7eec-4564-a4f6-52914e5a6c5b" containerName="authorino" Jun 12 20:25:11.746904 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.746888 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc357601-7eec-4564-a4f6-52914e5a6c5b" containerName="authorino" Jun 12 20:25:11.747101 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.747088 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc357601-7eec-4564-a4f6-52914e5a6c5b" containerName="authorino" Jun 12 20:25:11.750439 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.750416 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.754001 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.753980 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jun 12 20:25:11.754122 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.754028 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-t9mdh\"" Jun 12 20:25:11.754122 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.753982 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jun 12 20:25:11.754122 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.754059 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jun 12 20:25:11.759308 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.758832 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg"] Jun 12 20:25:11.846135 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846101 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dknp8\" (UniqueName: \"kubernetes.io/projected/ccff1c6c-4366-4cfb-9940-61afde093f92-kube-api-access-dknp8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.846253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846155 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.846253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846197 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.846253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846233 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.846368 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846261 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccff1c6c-4366-4cfb-9940-61afde093f92-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.846368 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.846300 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947634 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947610 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947638 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccff1c6c-4366-4cfb-9940-61afde093f92-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947667 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947694 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dknp8\" (UniqueName: \"kubernetes.io/projected/ccff1c6c-4366-4cfb-9940-61afde093f92-kube-api-access-dknp8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947740 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.947763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.947762 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.948171 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.948145 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-home\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.948171 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.948160 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-model-cache\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.948368 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.948194 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-kserve-provision-location\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.950182 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.950152 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ccff1c6c-4366-4cfb-9940-61afde093f92-dshm\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.950335 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.950317 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ccff1c6c-4366-4cfb-9940-61afde093f92-tls-certs\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:11.956138 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:11.956115 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dknp8\" (UniqueName: \"kubernetes.io/projected/ccff1c6c-4366-4cfb-9940-61afde093f92-kube-api-access-dknp8\") pod \"e2e-distinct-simulated-kserve-5cdff5474d-bcblg\" (UID: \"ccff1c6c-4366-4cfb-9940-61afde093f92\") " pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:12.063992 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:12.063937 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:25:12.188943 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:12.188920 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg"] Jun 12 20:25:12.191071 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:25:12.191046 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podccff1c6c_4366_4cfb_9940_61afde093f92.slice/crio-3273584eb4a5439e67c45cb3bb18ec2cb1a6052e18fd04369108ef996fc4d7bd WatchSource:0}: Error finding container 3273584eb4a5439e67c45cb3bb18ec2cb1a6052e18fd04369108ef996fc4d7bd: Status 404 returned error can't find the container with id 3273584eb4a5439e67c45cb3bb18ec2cb1a6052e18fd04369108ef996fc4d7bd Jun 12 20:25:12.305028 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:12.304999 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" event={"ID":"ccff1c6c-4366-4cfb-9940-61afde093f92","Type":"ContainerStarted","Data":"3273584eb4a5439e67c45cb3bb18ec2cb1a6052e18fd04369108ef996fc4d7bd"} Jun 12 20:25:12.479760 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:12.479680 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:16.326615 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:16.326581 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" event={"ID":"ccff1c6c-4366-4cfb-9940-61afde093f92","Type":"ContainerStarted","Data":"cbd63ecbb8478abee2eaeddfd23f43bf52d37f65a4ab8592e3d033c7cd410759"} Jun 12 20:25:26.530229 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:26.530182 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:33.735471 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:33.735439 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:39.629938 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:39.629899 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:42.823779 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.823744 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2"] Jun 12 20:25:42.828809 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.828776 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.831314 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.831272 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\"" Jun 12 20:25:42.840441 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.840419 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2"] Jun 12 20:25:42.889540 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889514 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.889647 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889562 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dptpg\" (UniqueName: \"kubernetes.io/projected/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kube-api-access-dptpg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.889647 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889626 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.889752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889652 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37868cc4-9153-48b6-80e1-8aef0bb3ec33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.889752 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889689 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.889916 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.889783 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990412 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990375 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dptpg\" (UniqueName: \"kubernetes.io/projected/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kube-api-access-dptpg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990412 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990428 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990613 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990447 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37868cc4-9153-48b6-80e1-8aef0bb3ec33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990613 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990476 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990613 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990528 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990613 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990581 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990847 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990821 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-model-cache\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.990992 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.990973 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-home\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.991053 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.991030 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kserve-provision-location\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kserve-provision-location\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.992775 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.992747 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/37868cc4-9153-48b6-80e1-8aef0bb3ec33-dshm\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.992961 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.992942 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/37868cc4-9153-48b6-80e1-8aef0bb3ec33-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:42.997705 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:42.997686 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dptpg\" (UniqueName: \"kubernetes.io/projected/37868cc4-9153-48b6-80e1-8aef0bb3ec33-kube-api-access-dptpg\") pod \"premium-simulated-simulated-premium-kserve-66967c79b-6jcp2\" (UID: \"37868cc4-9153-48b6-80e1-8aef0bb3ec33\") " pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:43.137514 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:43.137434 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:43.262889 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:43.262864 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2"] Jun 12 20:25:43.265307 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:25:43.265281 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod37868cc4_9153_48b6_80e1_8aef0bb3ec33.slice/crio-aa6cd0fe0327efdcce3c66c6163a5e0db79c508f4872f73966acf7a2787e01aa WatchSource:0}: Error finding container aa6cd0fe0327efdcce3c66c6163a5e0db79c508f4872f73966acf7a2787e01aa: Status 404 returned error can't find the container with id aa6cd0fe0327efdcce3c66c6163a5e0db79c508f4872f73966acf7a2787e01aa Jun 12 20:25:43.448038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:43.447950 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" event={"ID":"37868cc4-9153-48b6-80e1-8aef0bb3ec33","Type":"ContainerStarted","Data":"4ab61e350e080deafa4e1a4fad99c606382c99762bee990a43c7b80dcd3339ab"} Jun 12 20:25:43.448038 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:43.448003 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" event={"ID":"37868cc4-9153-48b6-80e1-8aef0bb3ec33","Type":"ContainerStarted","Data":"aa6cd0fe0327efdcce3c66c6163a5e0db79c508f4872f73966acf7a2787e01aa"} Jun 12 20:25:44.724152 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:44.724108 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:25:45.457165 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:45.457087 2579 generic.go:356] "Generic (PLEG): container finished" podID="37868cc4-9153-48b6-80e1-8aef0bb3ec33" containerID="4ab61e350e080deafa4e1a4fad99c606382c99762bee990a43c7b80dcd3339ab" exitCode=0 Jun 12 20:25:45.457307 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:45.457160 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" event={"ID":"37868cc4-9153-48b6-80e1-8aef0bb3ec33","Type":"ContainerDied","Data":"4ab61e350e080deafa4e1a4fad99c606382c99762bee990a43c7b80dcd3339ab"} Jun 12 20:25:47.467404 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:47.467371 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" event={"ID":"37868cc4-9153-48b6-80e1-8aef0bb3ec33","Type":"ContainerStarted","Data":"eedefb95307ae943ba3225d91683ee7adfe6760b57bcc8c6a0a90923e7489842"} Jun 12 20:25:47.490260 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:47.490212 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" podStartSLOduration=2.622715368 podStartE2EDuration="5.490197543s" totalImagesPullingTime="1.021963237s" totalInitContainerRuntime="1.845518938s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:25:47.487957107 +0000 UTC m=+966.358382352" watchObservedRunningTime="2026-06-12 20:25:47.490197543 +0000 UTC m=+966.360622833" Jun 12 20:25:53.137724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:53.137648 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:53.137724 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:53.137702 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:53.149857 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:53.149835 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:25:53.506433 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:25:53.506405 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-66967c79b-6jcp2" Jun 12 20:26:11.580028 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:11.579994 2579 generic.go:356] "Generic (PLEG): container finished" podID="ccff1c6c-4366-4cfb-9940-61afde093f92" containerID="cbd63ecbb8478abee2eaeddfd23f43bf52d37f65a4ab8592e3d033c7cd410759" exitCode=0 Jun 12 20:26:11.580382 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:11.580056 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" event={"ID":"ccff1c6c-4366-4cfb-9940-61afde093f92","Type":"ContainerDied","Data":"cbd63ecbb8478abee2eaeddfd23f43bf52d37f65a4ab8592e3d033c7cd410759"} Jun 12 20:26:12.586938 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:12.586903 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" event={"ID":"ccff1c6c-4366-4cfb-9940-61afde093f92","Type":"ContainerStarted","Data":"aa3afb59a1778824b1292833ea045d0cb6635ad5179433b077764086cff96ea4"} Jun 12 20:26:12.605258 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:12.605211 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" podStartSLOduration=2.461531969 podStartE2EDuration="1m1.605195446s" totalImagesPullingTime="3.48865962s" totalInitContainerRuntime="55.655003857s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:25:11 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:26:12.60485718 +0000 UTC m=+991.475282426" watchObservedRunningTime="2026-06-12 20:26:12.605195446 +0000 UTC m=+991.475620691" Jun 12 20:26:22.064457 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:22.064429 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:26:22.064974 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:22.064736 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:26:22.076931 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:22.076908 2579 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:26:22.646065 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:22.646033 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-5cdff5474d-bcblg" Jun 12 20:26:34.860823 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.860774 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5f9d97c567-xcsnq"] Jun 12 20:26:34.863885 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.863868 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:34.871059 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.871031 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f9d97c567-xcsnq"] Jun 12 20:26:34.990956 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.990926 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpz7w\" (UniqueName: \"kubernetes.io/projected/3468862a-0bc0-4a1e-aa4a-8b414699d461-kube-api-access-xpz7w\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:34.991095 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.991022 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3468862a-0bc0-4a1e-aa4a-8b414699d461-tls-cert\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:34.991165 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:34.991093 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3468862a-0bc0-4a1e-aa4a-8b414699d461-oidc-ca\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.092311 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.092280 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3468862a-0bc0-4a1e-aa4a-8b414699d461-oidc-ca\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.092443 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.092321 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpz7w\" (UniqueName: \"kubernetes.io/projected/3468862a-0bc0-4a1e-aa4a-8b414699d461-kube-api-access-xpz7w\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.092443 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.092372 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3468862a-0bc0-4a1e-aa4a-8b414699d461-tls-cert\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.093023 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.093002 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/3468862a-0bc0-4a1e-aa4a-8b414699d461-oidc-ca\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.094543 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.094517 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/3468862a-0bc0-4a1e-aa4a-8b414699d461-tls-cert\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.106076 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.106054 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpz7w\" (UniqueName: \"kubernetes.io/projected/3468862a-0bc0-4a1e-aa4a-8b414699d461-kube-api-access-xpz7w\") pod \"authorino-5f9d97c567-xcsnq\" (UID: \"3468862a-0bc0-4a1e-aa4a-8b414699d461\") " pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.173156 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.173107 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5f9d97c567-xcsnq" Jun 12 20:26:35.300535 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.300511 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5f9d97c567-xcsnq"] Jun 12 20:26:35.302239 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:26:35.302209 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3468862a_0bc0_4a1e_aa4a_8b414699d461.slice/crio-bcdc1ad6830f1c20ea9c3f78874eb52751fae04f6903400f56342431f7d4d8c0 WatchSource:0}: Error finding container bcdc1ad6830f1c20ea9c3f78874eb52751fae04f6903400f56342431f7d4d8c0: Status 404 returned error can't find the container with id bcdc1ad6830f1c20ea9c3f78874eb52751fae04f6903400f56342431f7d4d8c0 Jun 12 20:26:35.693944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:35.693913 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9d97c567-xcsnq" event={"ID":"3468862a-0bc0-4a1e-aa4a-8b414699d461","Type":"ContainerStarted","Data":"bcdc1ad6830f1c20ea9c3f78874eb52751fae04f6903400f56342431f7d4d8c0"} Jun 12 20:26:36.701442 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:36.701406 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5f9d97c567-xcsnq" event={"ID":"3468862a-0bc0-4a1e-aa4a-8b414699d461","Type":"ContainerStarted","Data":"bb7df76733f5aad8dd703fac92d8ef0ca02bcd307450eb4a83dfb0163d593eac"} Jun 12 20:26:36.716764 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:36.716712 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5f9d97c567-xcsnq" podStartSLOduration=2.357393964 podStartE2EDuration="2.716697098s" totalImagesPullingTime="359.303134ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:26:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:26:36.71466882 +0000 UTC m=+1015.585094065" watchObservedRunningTime="2026-06-12 20:26:36.716697098 +0000 UTC m=+1015.587122343" Jun 12 20:26:36.740119 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:36.740071 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:26:36.740497 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:36.740446 2579 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-78857b776b-k89cw" podUID="72493120-14bc-4fe9-864f-3387ed7fb5dc" containerName="authorino" containerID="cri-o://6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7" gracePeriod=30 Jun 12 20:26:36.996469 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:36.996444 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:26:37.110176 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.110145 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9v2v2\" (UniqueName: \"kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2\") pod \"72493120-14bc-4fe9-864f-3387ed7fb5dc\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " Jun 12 20:26:37.110311 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.110236 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca\") pod \"72493120-14bc-4fe9-864f-3387ed7fb5dc\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " Jun 12 20:26:37.110311 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.110277 2579 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert\") pod \"72493120-14bc-4fe9-864f-3387ed7fb5dc\" (UID: \"72493120-14bc-4fe9-864f-3387ed7fb5dc\") " Jun 12 20:26:37.112401 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.112366 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2" (OuterVolumeSpecName: "kube-api-access-9v2v2") pod "72493120-14bc-4fe9-864f-3387ed7fb5dc" (UID: "72493120-14bc-4fe9-864f-3387ed7fb5dc"). InnerVolumeSpecName "kube-api-access-9v2v2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 20:26:37.114894 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.114869 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca" (OuterVolumeSpecName: "oidc-ca") pod "72493120-14bc-4fe9-864f-3387ed7fb5dc" (UID: "72493120-14bc-4fe9-864f-3387ed7fb5dc"). InnerVolumeSpecName "oidc-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 20:26:37.119545 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.119520 2579 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "72493120-14bc-4fe9-864f-3387ed7fb5dc" (UID: "72493120-14bc-4fe9-864f-3387ed7fb5dc"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 20:26:37.211353 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.211328 2579 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/72493120-14bc-4fe9-864f-3387ed7fb5dc-tls-cert\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:26:37.211353 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.211351 2579 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9v2v2\" (UniqueName: \"kubernetes.io/projected/72493120-14bc-4fe9-864f-3387ed7fb5dc-kube-api-access-9v2v2\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:26:37.211485 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.211363 2579 reconciler_common.go:299] "Volume detached for volume \"oidc-ca\" (UniqueName: \"kubernetes.io/configmap/72493120-14bc-4fe9-864f-3387ed7fb5dc-oidc-ca\") on node \"ip-10-0-137-64.ec2.internal\" DevicePath \"\"" Jun 12 20:26:37.706861 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.706820 2579 generic.go:356] "Generic (PLEG): container finished" podID="72493120-14bc-4fe9-864f-3387ed7fb5dc" containerID="6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7" exitCode=0 Jun 12 20:26:37.707325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.706863 2579 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-78857b776b-k89cw" Jun 12 20:26:37.707325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.706910 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78857b776b-k89cw" event={"ID":"72493120-14bc-4fe9-864f-3387ed7fb5dc","Type":"ContainerDied","Data":"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7"} Jun 12 20:26:37.707325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.706947 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-78857b776b-k89cw" event={"ID":"72493120-14bc-4fe9-864f-3387ed7fb5dc","Type":"ContainerDied","Data":"4d47c8bfdf82ca7313ec6e0f449a2204d41b7b5948205dc6ad124b3541dfdf4f"} Jun 12 20:26:37.707325 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.706964 2579 scope.go:117] "RemoveContainer" containerID="6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7" Jun 12 20:26:37.716022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.716004 2579 scope.go:117] "RemoveContainer" containerID="6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7" Jun 12 20:26:37.716252 ip-10-0-137-64 kubenswrapper[2579]: E0612 20:26:37.716233 2579 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7\": container with ID starting with 6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7 not found: ID does not exist" containerID="6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7" Jun 12 20:26:37.716298 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.716259 2579 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7"} err="failed to get container status \"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7\": rpc error: code = NotFound desc = could not find container \"6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7\": container with ID starting with 6ef6ca653e9242075f05caebbb905f8b7b6c43712acfa6bf778283fedabb4ba7 not found: ID does not exist" Jun 12 20:26:37.724932 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.724912 2579 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:26:37.727871 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:37.727852 2579 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-78857b776b-k89cw"] Jun 12 20:26:39.574763 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:26:39.574729 2579 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72493120-14bc-4fe9-864f-3387ed7fb5dc" path="/var/lib/kubelet/pods/72493120-14bc-4fe9-864f-3387ed7fb5dc/volumes" Jun 12 20:27:09.434737 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:09.434693 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:27:19.057631 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:19.057598 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:27:28.632697 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:28.632659 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:27:38.326757 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:38.326718 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:27:47.830873 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:47.830834 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:27:57.734968 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:27:57.734934 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:28:30.526432 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:28:30.526396 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:28:34.327217 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:28:34.327175 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:29:10.640449 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:29:10.640368 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:29:25.826543 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:29:25.826507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:29:41.609343 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:29:41.609313 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:29:41.612053 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:29:41.612034 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:30:04.945657 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:30:04.945620 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:30:21.727568 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:30:21.727474 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:30:36.133080 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:30:36.133043 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:30:51.333529 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:30:51.333475 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:30:55.232455 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:30:55.232415 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:31:29.625952 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:31:29.625918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:31:33.830814 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:31:33.830764 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:31:54.839253 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:31:54.839170 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:32:04.052073 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:32:04.052034 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:32:20.978599 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:32:20.978561 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:32:29.460627 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:32:29.460592 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:32:46.884120 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:32:46.884082 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:32:55.448642 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:32:55.448607 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:33:27.831716 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:33:27.831684 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:33:36.544365 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:33:36.544328 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:33:45.503451 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:33:45.503417 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:33:53.039735 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:33:53.039700 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:01.546275 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:01.546245 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:10.435966 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:10.435927 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:14.142584 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:14.142547 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:27.037631 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:27.037594 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:40.740648 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:40.740608 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:34:41.636174 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:41.636147 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:34:41.638839 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:34:41.638818 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:35:09.731887 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:35:09.731854 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:35:12.330392 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:35:12.330351 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:35:30.524926 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:35:30.524890 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:35:36.838629 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:35:36.838585 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:35:55.970076 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:35:55.970039 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:01.130895 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:01.130850 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:04.847444 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:04.847413 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:14.636493 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:14.636456 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:22.425022 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:22.424944 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:32.756033 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:32.755998 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:40.035077 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:40.035045 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:50.535170 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:50.535130 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:36:57.540395 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:36:57.540357 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:37:05.757177 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:37:05.757144 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:37:14.043579 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:37:14.043543 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:39:36.941992 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:39:36.941954 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:39:41.662651 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:39:41.662623 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:39:41.666182 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:39:41.666160 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:39:42.160011 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:39:42.159979 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:09.132282 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:09.132233 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:12.625943 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:12.625907 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:23.546289 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:23.546253 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:32.750473 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:32.750438 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:42.943634 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:42.943596 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:40:52.449742 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:40:52.449660 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:02.338525 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:02.338490 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:11.834309 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:11.834273 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:22.033132 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:22.033095 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:30.442321 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:30.442285 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:40.242410 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:40.242369 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:41:45.455135 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:41:45.455098 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:42:13.277919 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:42:13.277881 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:42:57.539445 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:42:57.539406 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:05.332996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:05.332918 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:15.052768 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:15.052734 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:22.331393 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:22.331357 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:31.948291 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:31.948254 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:43.637556 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:43.637507 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:54.234095 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:54.234016 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:43:58.337326 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:43:58.337284 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:44:08.670192 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:08.670156 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:44:14.940618 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:14.940584 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:44:23.736005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:23.735973 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:44:34.445521 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:34.445477 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:44:41.690304 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:41.690279 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:44:41.695444 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:41.695426 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:44:53.545076 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:44:53.545040 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:01.030046 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:01.030008 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:11.234309 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:11.234276 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:17.458965 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:17.458927 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:36.742052 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:36.742012 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:43.668294 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:43.668253 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:45:53.554349 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:45:53.554315 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:00.232710 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:00.232669 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:10.837183 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:10.837149 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:18.546884 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:18.546844 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:28.935527 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:28.935488 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:40.233215 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:40.233178 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:46:50.636856 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:46:50.636771 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:02.531272 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:02.531240 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:13.032745 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:13.032711 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:16.952330 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:16.952286 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:27.932907 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:27.932871 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:31.941131 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:31.941095 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:48.631347 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:48.631311 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:47:57.339602 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:47:57.339562 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:48:06.739444 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:48:06.739409 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:48:12.956203 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:48:12.956163 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:48:34.535981 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:48:34.535950 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:48:46.439323 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:48:46.439289 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:48:52.833067 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:48:52.833030 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-77wks"] Jun 12 20:49:22.152058 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:22.152025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f9d97c567-xcsnq_3468862a-0bc0-4a1e-aa4a-8b414699d461/authorino/0.log" Jun 12 20:49:27.805880 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:27.805848 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-nrtvc_9105eafc-08c3-4316-ac8c-72c7b795aef4/copy-manifests/0.log" Jun 12 20:49:27.814240 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:27.814202 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-nrtvc_9105eafc-08c3-4316-ac8c-72c7b795aef4/manager/0.log" Jun 12 20:49:29.298282 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:29.298253 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f9d97c567-xcsnq_3468862a-0bc0-4a1e-aa4a-8b414699d461/authorino/0.log" Jun 12 20:49:29.422944 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:29.422921 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m2qqd_c70e4c52-d07e-4a95-b2f3-ae75c00c6532/manager/0.log" Jun 12 20:49:29.997889 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:29.997855 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-77wks_e2fc5db9-b87e-49fd-86e5-08b85eb3aaca/limitador/0.log" Jun 12 20:49:30.695915 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:30.695886 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb5559799-2jzbr_1802efe4-85d9-43a7-b779-c9c8d8bbe868/kube-auth-proxy/0.log" Jun 12 20:49:31.726255 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:31.726212 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bcblg_ccff1c6c-4366-4cfb-9940-61afde093f92/storage-initializer/0.log" Jun 12 20:49:31.734055 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:31.734025 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-5cdff5474d-bcblg_ccff1c6c-4366-4cfb-9940-61afde093f92/main/0.log" Jun 12 20:49:32.192269 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:32.192239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-6jcp2_37868cc4-9153-48b6-80e1-8aef0bb3ec33/storage-initializer/0.log" Jun 12 20:49:32.199419 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:32.199392 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-66967c79b-6jcp2_37868cc4-9153-48b6-80e1-8aef0bb3ec33/main/0.log" Jun 12 20:49:36.337589 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.337553 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqgjv/must-gather-7485j"] Jun 12 20:49:36.337989 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.337906 2579 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72493120-14bc-4fe9-864f-3387ed7fb5dc" containerName="authorino" Jun 12 20:49:36.337989 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.337918 2579 state_mem.go:107] "Deleted CPUSet assignment" podUID="72493120-14bc-4fe9-864f-3387ed7fb5dc" containerName="authorino" Jun 12 20:49:36.337989 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.337969 2579 memory_manager.go:368] "RemoveStaleState removing state" podUID="72493120-14bc-4fe9-864f-3387ed7fb5dc" containerName="authorino" Jun 12 20:49:36.340984 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.340964 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.344665 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.344648 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqgjv\"/\"kube-root-ca.crt\"" Jun 12 20:49:36.345510 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.345493 2579 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-wqgjv\"/\"default-dockercfg-d52hd\"" Jun 12 20:49:36.345599 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.345508 2579 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-wqgjv\"/\"openshift-service-ca.crt\"" Jun 12 20:49:36.356472 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.356446 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/must-gather-7485j"] Jun 12 20:49:36.495492 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.495454 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4gwk\" (UniqueName: \"kubernetes.io/projected/de891228-d769-407a-a0ca-15324a29acdf-kube-api-access-l4gwk\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.495693 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.495511 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de891228-d769-407a-a0ca-15324a29acdf-must-gather-output\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.596391 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.596298 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4gwk\" (UniqueName: \"kubernetes.io/projected/de891228-d769-407a-a0ca-15324a29acdf-kube-api-access-l4gwk\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.596391 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.596356 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de891228-d769-407a-a0ca-15324a29acdf-must-gather-output\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.596715 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.596695 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/de891228-d769-407a-a0ca-15324a29acdf-must-gather-output\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.612563 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.612533 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4gwk\" (UniqueName: \"kubernetes.io/projected/de891228-d769-407a-a0ca-15324a29acdf-kube-api-access-l4gwk\") pod \"must-gather-7485j\" (UID: \"de891228-d769-407a-a0ca-15324a29acdf\") " pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.650082 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.650055 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/must-gather-7485j" Jun 12 20:49:36.797547 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.797519 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/must-gather-7485j"] Jun 12 20:49:36.799222 ip-10-0-137-64 kubenswrapper[2579]: W0612 20:49:36.799196 2579 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podde891228_d769_407a_a0ca_15324a29acdf.slice/crio-dee3263076d66fb5a472f8a9d8627edb1e068c7e832a8ee8d53775b1d4018857 WatchSource:0}: Error finding container dee3263076d66fb5a472f8a9d8627edb1e068c7e832a8ee8d53775b1d4018857: Status 404 returned error can't find the container with id dee3263076d66fb5a472f8a9d8627edb1e068c7e832a8ee8d53775b1d4018857 Jun 12 20:49:36.801027 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.801012 2579 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 20:49:36.835996 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:36.835967 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/must-gather-7485j" event={"ID":"de891228-d769-407a-a0ca-15324a29acdf","Type":"ContainerStarted","Data":"dee3263076d66fb5a472f8a9d8627edb1e068c7e832a8ee8d53775b1d4018857"} Jun 12 20:49:38.849272 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:38.849234 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/must-gather-7485j" event={"ID":"de891228-d769-407a-a0ca-15324a29acdf","Type":"ContainerStarted","Data":"509dfe155649ca8dbc79c95f71afa22c5028e44158e73539eead494465907f8a"} Jun 12 20:49:38.849637 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:38.849283 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/must-gather-7485j" event={"ID":"de891228-d769-407a-a0ca-15324a29acdf","Type":"ContainerStarted","Data":"a49bbc2248811a60366f0ccd116909ddafb05197af249fa3eb4066183169f2f4"} Jun 12 20:49:38.878016 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:38.877948 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqgjv/must-gather-7485j" podStartSLOduration=1.8787823769999998 podStartE2EDuration="2.877932655s" totalImagesPullingTime="999.150278ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 20:49:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:49:38.877391396 +0000 UTC m=+2397.747816640" watchObservedRunningTime="2026-06-12 20:49:38.877932655 +0000 UTC m=+2397.748357900" Jun 12 20:49:39.739565 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:39.739527 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qzv8j_6af625a6-463a-466a-b491-6461e57cfde9/global-pull-secret-syncer/0.log" Jun 12 20:49:39.856175 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:39.856145 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-hznww_0e28d3fc-14ed-442e-be78-9930417a5fa8/konnectivity-agent/0.log" Jun 12 20:49:39.931184 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:39.931151 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-137-64.ec2.internal_3de76128908ab97fc26daab2e5570029/haproxy/0.log" Jun 12 20:49:41.745319 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:41.745293 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:49:41.747141 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:41.747120 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-scr5q_8518d8a7-4f34-4b98-af15-e5cc5d2f32b4/ovn-acl-logging/0.log" Jun 12 20:49:45.644672 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:45.644579 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5f9d97c567-xcsnq_3468862a-0bc0-4a1e-aa4a-8b414699d461/authorino/0.log" Jun 12 20:49:45.679470 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:45.679421 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-m2qqd_c70e4c52-d07e-4a95-b2f3-ae75c00c6532/manager/0.log" Jun 12 20:49:45.933650 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:45.933613 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-77wks_e2fc5db9-b87e-49fd-86e5-08b85eb3aaca/limitador/0.log" Jun 12 20:49:47.952349 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:47.952298 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-state-metrics/0.log" Jun 12 20:49:47.972976 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:47.972941 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-rbac-proxy-main/0.log" Jun 12 20:49:48.002019 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.001980 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-678bc549d7-5jmqw_5bfdb0ca-9143-44d4-86f0-37490a1d202f/kube-rbac-proxy-self/0.log" Jun 12 20:49:48.065272 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.065239 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-589576dfc7-flgl4_0241e18e-705d-49d5-a99e-1c48cd067ed6/monitoring-plugin/0.log" Jun 12 20:49:48.178563 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.178525 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/node-exporter/0.log" Jun 12 20:49:48.205150 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.205046 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/kube-rbac-proxy/0.log" Jun 12 20:49:48.234418 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.234361 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-fpczf_90dc2fa2-9321-4401-a7d6-65c8ffb30959/init-textfile/0.log" Jun 12 20:49:48.350922 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.350877 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/kube-rbac-proxy-main/0.log" Jun 12 20:49:48.376698 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.376670 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/kube-rbac-proxy-self/0.log" Jun 12 20:49:48.398989 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.398958 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-bwzdm_3191cde6-814c-4e21-ac3f-b9cdc2469465/openshift-state-metrics/0.log" Jun 12 20:49:48.438281 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.438249 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/prometheus/0.log" Jun 12 20:49:48.467231 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.467144 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/config-reloader/0.log" Jun 12 20:49:48.492148 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.492117 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/thanos-sidecar/0.log" Jun 12 20:49:48.515868 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.515832 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/kube-rbac-proxy-web/0.log" Jun 12 20:49:48.541345 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.541310 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/kube-rbac-proxy/0.log" Jun 12 20:49:48.566948 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.566919 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/kube-rbac-proxy-thanos/0.log" Jun 12 20:49:48.590807 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:48.590764 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_718b41c4-0eb7-48f8-abdb-b883e352aeb2/init-config-reloader/0.log" Jun 12 20:49:50.804042 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.803533 2579 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw"] Jun 12 20:49:50.811899 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.811872 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.813476 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.813445 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw"] Jun 12 20:49:50.851049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.850753 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-lib-modules\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.851049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.850841 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-proc\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.851049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.850871 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nx7hf\" (UniqueName: \"kubernetes.io/projected/b90775c0-2320-4301-baba-44a90c429b24-kube-api-access-nx7hf\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.851049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.850943 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-sys\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.851049 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.850977 2579 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-podres\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.951733 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951699 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-sys\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.951733 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951738 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-podres\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951767 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-lib-modules\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951852 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-proc\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951880 2579 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nx7hf\" (UniqueName: \"kubernetes.io/projected/b90775c0-2320-4301-baba-44a90c429b24-kube-api-access-nx7hf\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951928 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-lib-modules\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951933 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-proc\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952005 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.951876 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-sys\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.952322 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.952017 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b90775c0-2320-4301-baba-44a90c429b24-podres\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:50.960030 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:50.959996 2579 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nx7hf\" (UniqueName: \"kubernetes.io/projected/b90775c0-2320-4301-baba-44a90c429b24-kube-api-access-nx7hf\") pod \"perf-node-gather-daemonset-47wxw\" (UID: \"b90775c0-2320-4301-baba-44a90c429b24\") " pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:51.126885 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.126774 2579 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:51.333245 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.333212 2579 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw"] Jun 12 20:49:51.432003 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.431976 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cf4b557dc-ml6zs_0d5892eb-5d50-4f20-88a7-8678c9344d47/console/0.log" Jun 12 20:49:51.942956 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.942909 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" event={"ID":"b90775c0-2320-4301-baba-44a90c429b24","Type":"ContainerStarted","Data":"63db85eeb27dcb211ba31781303d73cbe9b75721568285ff34b839eca3319311"} Jun 12 20:49:51.943448 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.942989 2579 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" event={"ID":"b90775c0-2320-4301-baba-44a90c429b24","Type":"ContainerStarted","Data":"c32ddd6806eaf2f44874ba1b89a2bdcba06526fe1ba93c07a870defdb23f447e"} Jun 12 20:49:51.943855 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.943828 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:51.959804 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:51.959736 2579 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" podStartSLOduration=1.959705982 podStartE2EDuration="1.959705982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 20:49:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 20:49:51.958211432 +0000 UTC m=+2410.828636680" watchObservedRunningTime="2026-06-12 20:49:51.959705982 +0000 UTC m=+2410.830131228" Jun 12 20:49:53.348204 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:53.348176 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvs42_70eee006-4f8c-4aa6-9e12-084be5161b3e/dns/0.log" Jun 12 20:49:53.377454 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:53.377424 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-mvs42_70eee006-4f8c-4aa6-9e12-084be5161b3e/kube-rbac-proxy/0.log" Jun 12 20:49:53.430286 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:53.430257 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-ffk9h_e8d200bc-f584-417e-9d47-826ad9507d62/dns-node-resolver/0.log" Jun 12 20:49:54.049692 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:54.049655 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-q8p5x_cbc778f6-80ac-4480-bc10-55479741f6ba/node-ca/0.log" Jun 12 20:49:55.089448 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:55.089395 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb5559799-2jzbr_1802efe4-85d9-43a7-b779-c9c8d8bbe868/kube-auth-proxy/0.log" Jun 12 20:49:55.954109 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:55.954079 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-cgsxb_c61ef41a-e865-48c9-8500-f06b2359daac/serve-healthcheck-canary/0.log" Jun 12 20:49:56.519759 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:56.519727 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4hzsk_49068369-b4b7-486e-ac52-2a8f42b487d4/kube-rbac-proxy/0.log" Jun 12 20:49:56.549700 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:56.549672 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4hzsk_49068369-b4b7-486e-ac52-2a8f42b487d4/exporter/0.log" Jun 12 20:49:56.575544 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:56.575518 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-4hzsk_49068369-b4b7-486e-ac52-2a8f42b487d4/extractor/0.log" Jun 12 20:49:58.963551 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:58.963515 2579 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-wqgjv/perf-node-gather-daemonset-47wxw" Jun 12 20:49:59.947572 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:59.947528 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-nrtvc_9105eafc-08c3-4316-ac8c-72c7b795aef4/manager/0.log" Jun 12 20:49:59.972452 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:49:59.972422 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-68bb89b4d-nrtvc_9105eafc-08c3-4316-ac8c-72c7b795aef4/copy-manifests/0.log" Jun 12 20:50:01.889865 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:01.889835 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-546dccc465-8wzvq_f1076377-dc25-4bca-ac67-53d9d24eccd7/manager/0.log" Jun 12 20:50:04.287529 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:04.287498 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb5559799-2jzbr_1802efe4-85d9-43a7-b779-c9c8d8bbe868/kube-auth-proxy/0.log" Jun 12 20:50:05.739077 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:05.739042 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb5559799-2jzbr_1802efe4-85d9-43a7-b779-c9c8d8bbe868/kube-auth-proxy/0.log" Jun 12 20:50:07.315162 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:07.315134 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-55lm4_a8baab42-7319-43f4-a6d0-84e5a11d8a03/migrator/0.log" Jun 12 20:50:07.338334 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:07.338307 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-55lm4_a8baab42-7319-43f4-a6d0-84e5a11d8a03/graceful-termination/0.log" Jun 12 20:50:07.722167 ip-10-0-137-64 kubenswrapper[2579]: I0612 20:50:07.722095 2579 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7cb5559799-2jzbr_1802efe4-85d9-43a7-b779-c9c8d8bbe868/kube-auth-proxy/0.log"