Jun 12 18:21:49.017656 ip-10-0-138-101 systemd[1]: Starting Kubernetes Kubelet... Jun 12 18:21:49.459690 ip-10-0-138-101 kubenswrapper[2575]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:49.459690 ip-10-0-138-101 kubenswrapper[2575]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jun 12 18:21:49.459690 ip-10-0-138-101 kubenswrapper[2575]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:49.459690 ip-10-0-138-101 kubenswrapper[2575]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jun 12 18:21:49.460291 ip-10-0-138-101 kubenswrapper[2575]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jun 12 18:21:49.460515 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.460430 2575 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jun 12 18:21:49.464987 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.464966 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.464987 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.464987 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.464991 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.464994 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.464997 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465000 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465004 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465007 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465010 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465013 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465022 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465025 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465027 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465030 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465033 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465035 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465038 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465041 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465044 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465046 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465049 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.465054 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465052 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465054 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465058 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465061 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465063 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465066 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465069 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465071 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465074 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465076 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465079 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465082 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465084 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465087 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465089 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465092 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465094 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465098 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465100 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.465523 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465104 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465108 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465110 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465113 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465116 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465118 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465120 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465123 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465125 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465129 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465131 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465134 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465136 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465139 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465142 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465145 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465148 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465151 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465153 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465156 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.465972 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465159 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465161 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465164 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465166 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465168 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465171 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465173 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465176 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465178 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465181 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465183 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465186 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465189 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465191 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465194 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465196 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465199 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465204 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465208 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.466459 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465210 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465213 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465216 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465218 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465221 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465224 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465226 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465229 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465232 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465235 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465238 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465240 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465243 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465246 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465248 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465251 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465253 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465256 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465260 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.465263 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.466901 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466034 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466041 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466045 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466048 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466051 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466055 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466058 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466061 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466064 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466067 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466069 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466072 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466075 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466077 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466080 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466082 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466085 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466088 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466090 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466093 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.467381 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466095 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466098 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466100 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466103 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466106 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466109 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466111 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466114 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466117 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466119 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466122 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466124 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466126 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466129 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466131 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466134 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466137 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466139 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466143 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466145 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.467879 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466148 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466150 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466152 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466155 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466158 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466160 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466163 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466165 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466167 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466170 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466172 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466175 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466178 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466180 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466183 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466185 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466189 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466192 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466194 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466197 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.468382 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466199 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466202 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466204 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466207 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466210 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466212 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466215 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466217 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466220 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466223 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466226 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466229 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466232 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466234 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466237 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466240 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466242 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466245 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466247 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466250 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.468860 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466253 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466255 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466258 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466260 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466263 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466265 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466269 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466271 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466275 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466278 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466281 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466284 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466287 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466291 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466295 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466299 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466302 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466304 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.469359 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466307 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466718 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466724 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466727 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466730 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466735 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466739 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466742 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466745 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466747 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466750 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466753 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466755 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466758 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466761 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466763 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466766 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466768 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466772 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.469808 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466774 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466777 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466779 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466782 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466785 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466787 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466791 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466793 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466796 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466798 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466801 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466804 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466806 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466809 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466811 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466814 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466817 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466819 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466821 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466824 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.470283 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466827 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466829 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466832 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466834 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466837 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466839 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466841 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466844 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466846 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466849 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466851 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466855 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466857 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466860 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466862 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466865 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466868 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466871 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466873 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466876 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.470782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466878 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466881 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466884 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466886 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466889 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466891 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466893 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466896 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466898 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466901 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466905 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466909 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466913 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466915 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466918 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466920 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466923 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466925 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466928 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466930 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.471256 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466934 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466936 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466939 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466942 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466944 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466947 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466949 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466952 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466955 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466958 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466960 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466963 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466965 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466968 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466970 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466973 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466975 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466978 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466980 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466983 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.471789 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.466986 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467063 2575 flags.go:64] FLAG: --address="0.0.0.0" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467074 2575 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467083 2575 flags.go:64] FLAG: --anonymous-auth="true" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467090 2575 flags.go:64] FLAG: --application-metrics-count-limit="100" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467096 2575 flags.go:64] FLAG: --authentication-token-webhook="false" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467101 2575 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467108 2575 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467114 2575 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467118 2575 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467121 2575 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467125 2575 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467128 2575 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467131 2575 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467134 2575 flags.go:64] FLAG: --cgroup-root="" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467138 2575 flags.go:64] FLAG: --cgroups-per-qos="true" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467141 2575 flags.go:64] FLAG: --client-ca-file="" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467143 2575 flags.go:64] FLAG: --cloud-provider="external" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467146 2575 flags.go:64] FLAG: --cluster-dns="[]" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467152 2575 flags.go:64] FLAG: --cluster-domain="" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467155 2575 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467158 2575 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467161 2575 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467164 2575 flags.go:64] FLAG: --container-log-max-files="5" Jun 12 18:21:49.472272 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467168 2575 flags.go:64] FLAG: --container-log-max-size="10Mi" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467171 2575 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467174 2575 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467177 2575 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467181 2575 flags.go:64] FLAG: --contention-profiling="false" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467184 2575 flags.go:64] FLAG: --cpu-cfs-quota="true" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467187 2575 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467190 2575 flags.go:64] FLAG: --cpu-manager-policy="none" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467193 2575 flags.go:64] FLAG: --cpu-manager-policy-options="" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467198 2575 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467200 2575 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467204 2575 flags.go:64] FLAG: --enable-debugging-handlers="true" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467207 2575 flags.go:64] FLAG: --enable-load-reader="false" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467210 2575 flags.go:64] FLAG: --enable-server="true" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467213 2575 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467217 2575 flags.go:64] FLAG: --event-burst="100" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467220 2575 flags.go:64] FLAG: --event-qps="50" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467223 2575 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467226 2575 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467229 2575 flags.go:64] FLAG: --eviction-hard="" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467233 2575 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467235 2575 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467238 2575 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467244 2575 flags.go:64] FLAG: --eviction-soft="" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467247 2575 flags.go:64] FLAG: --eviction-soft-grace-period="" Jun 12 18:21:49.472850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467250 2575 flags.go:64] FLAG: --exit-on-lock-contention="false" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467253 2575 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467256 2575 flags.go:64] FLAG: --experimental-mounter-path="" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467262 2575 flags.go:64] FLAG: --fail-cgroupv1="false" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467265 2575 flags.go:64] FLAG: --fail-swap-on="true" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467268 2575 flags.go:64] FLAG: --feature-gates="" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467272 2575 flags.go:64] FLAG: --file-check-frequency="20s" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467275 2575 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467278 2575 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467282 2575 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467285 2575 flags.go:64] FLAG: --healthz-port="10248" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467288 2575 flags.go:64] FLAG: --help="false" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467291 2575 flags.go:64] FLAG: --hostname-override="ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467294 2575 flags.go:64] FLAG: --housekeeping-interval="10s" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467297 2575 flags.go:64] FLAG: --http-check-frequency="20s" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467300 2575 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467303 2575 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467307 2575 flags.go:64] FLAG: --image-gc-high-threshold="85" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467309 2575 flags.go:64] FLAG: --image-gc-low-threshold="80" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467312 2575 flags.go:64] FLAG: --image-service-endpoint="" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467315 2575 flags.go:64] FLAG: --kernel-memcg-notification="false" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467318 2575 flags.go:64] FLAG: --kube-api-burst="100" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467321 2575 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467325 2575 flags.go:64] FLAG: --kube-api-qps="50" Jun 12 18:21:49.473487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467328 2575 flags.go:64] FLAG: --kube-reserved="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467330 2575 flags.go:64] FLAG: --kube-reserved-cgroup="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467345 2575 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467348 2575 flags.go:64] FLAG: --kubelet-cgroups="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467351 2575 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467354 2575 flags.go:64] FLAG: --lock-file="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467362 2575 flags.go:64] FLAG: --log-cadvisor-usage="false" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467365 2575 flags.go:64] FLAG: --log-flush-frequency="5s" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467368 2575 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467378 2575 flags.go:64] FLAG: --log-json-split-stream="false" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467381 2575 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467386 2575 flags.go:64] FLAG: --log-text-split-stream="false" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467389 2575 flags.go:64] FLAG: --logging-format="text" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467392 2575 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467396 2575 flags.go:64] FLAG: --make-iptables-util-chains="true" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467399 2575 flags.go:64] FLAG: --manifest-url="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467402 2575 flags.go:64] FLAG: --manifest-url-header="" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467406 2575 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467409 2575 flags.go:64] FLAG: --max-open-files="1000000" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467414 2575 flags.go:64] FLAG: --max-pods="110" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467417 2575 flags.go:64] FLAG: --maximum-dead-containers="-1" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467420 2575 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467423 2575 flags.go:64] FLAG: --memory-manager-policy="None" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467425 2575 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467429 2575 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jun 12 18:21:49.474079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467432 2575 flags.go:64] FLAG: --node-ip="0.0.0.0" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467435 2575 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467443 2575 flags.go:64] FLAG: --node-status-max-images="50" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467446 2575 flags.go:64] FLAG: --node-status-update-frequency="10s" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467449 2575 flags.go:64] FLAG: --oom-score-adj="-999" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467452 2575 flags.go:64] FLAG: --pod-cidr="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467456 2575 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4a2e90c8ef7d783e4d635e24fb09435f5e1f6e954583512c0944f9e57bc77b52" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467462 2575 flags.go:64] FLAG: --pod-manifest-path="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467465 2575 flags.go:64] FLAG: --pod-max-pids="-1" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467469 2575 flags.go:64] FLAG: --pods-per-core="0" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467472 2575 flags.go:64] FLAG: --port="10250" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467474 2575 flags.go:64] FLAG: --protect-kernel-defaults="false" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467477 2575 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0240b1d33abff4c72" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467482 2575 flags.go:64] FLAG: --qos-reserved="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467485 2575 flags.go:64] FLAG: --read-only-port="10255" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467487 2575 flags.go:64] FLAG: --register-node="true" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467490 2575 flags.go:64] FLAG: --register-with-taints="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467494 2575 flags.go:64] FLAG: --registry-burst="10" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467497 2575 flags.go:64] FLAG: --registry-qps="5" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467501 2575 flags.go:64] FLAG: --reserved-cpus="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467504 2575 flags.go:64] FLAG: --reserved-memory="" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467508 2575 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467511 2575 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467513 2575 flags.go:64] FLAG: --rotate-certificates="false" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467516 2575 flags.go:64] FLAG: --rotate-server-certificates="false" Jun 12 18:21:49.474680 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467519 2575 flags.go:64] FLAG: --runonce="false" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467522 2575 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467525 2575 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467528 2575 flags.go:64] FLAG: --seccomp-default="false" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467531 2575 flags.go:64] FLAG: --serialize-image-pulls="true" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467534 2575 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467536 2575 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467540 2575 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467543 2575 flags.go:64] FLAG: --storage-driver-password="root" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467546 2575 flags.go:64] FLAG: --storage-driver-secure="false" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467549 2575 flags.go:64] FLAG: --storage-driver-table="stats" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467552 2575 flags.go:64] FLAG: --storage-driver-user="root" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467554 2575 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467557 2575 flags.go:64] FLAG: --sync-frequency="1m0s" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467561 2575 flags.go:64] FLAG: --system-cgroups="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467563 2575 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467569 2575 flags.go:64] FLAG: --system-reserved-cgroup="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467571 2575 flags.go:64] FLAG: --tls-cert-file="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467574 2575 flags.go:64] FLAG: --tls-cipher-suites="[]" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467579 2575 flags.go:64] FLAG: --tls-min-version="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467583 2575 flags.go:64] FLAG: --tls-private-key-file="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467587 2575 flags.go:64] FLAG: --topology-manager-policy="none" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467589 2575 flags.go:64] FLAG: --topology-manager-policy-options="" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467592 2575 flags.go:64] FLAG: --topology-manager-scope="container" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467595 2575 flags.go:64] FLAG: --v="2" Jun 12 18:21:49.475275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467599 2575 flags.go:64] FLAG: --version="false" Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467604 2575 flags.go:64] FLAG: --vmodule="" Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467608 2575 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.467611 2575 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467737 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467741 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467744 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467746 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467749 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467752 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467755 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467758 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467761 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467763 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467766 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467768 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467771 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467774 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467777 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467779 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.475921 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467782 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467785 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467788 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467790 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467793 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467796 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467798 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467803 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467806 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467808 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467811 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467813 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467816 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467820 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467823 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467825 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467828 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467830 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467833 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467836 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467838 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.476456 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467841 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467843 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467846 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467849 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467851 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467854 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467856 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467859 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467862 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467864 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467867 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467869 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467872 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467874 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467879 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467883 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467886 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467889 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467893 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.476951 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467895 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467898 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467900 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467903 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467905 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467909 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467912 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467914 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467917 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467919 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467922 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467924 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467928 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467932 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467936 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467939 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467941 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467944 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467947 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.477423 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467951 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467954 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467957 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467960 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467963 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467966 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467969 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467971 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467974 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467977 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467979 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467982 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467986 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467989 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467991 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467994 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467996 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.467999 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468003 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468006 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.477895 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468008 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468011 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468013 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.468016 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.468513 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.477253 2575 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.477272 2575 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.477287 2575 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.477293 2575 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477374 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477380 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477384 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477387 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477390 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477392 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.478406 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477395 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477398 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477401 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477404 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477407 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477409 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477415 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477418 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477421 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477424 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477427 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477430 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477433 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477436 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477438 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477441 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477444 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477447 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477450 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.478774 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477453 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477455 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477458 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477461 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477464 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477466 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477469 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477471 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477475 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477477 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477480 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477483 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477485 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477488 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477490 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477493 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477495 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477498 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477500 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477503 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.479220 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477511 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477514 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477517 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477520 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477522 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477526 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477530 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477533 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477536 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477540 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477543 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477546 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477548 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477551 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477554 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477556 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477559 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477562 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477564 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477567 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.479787 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477570 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477572 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477575 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477577 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477580 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477582 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477585 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477588 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477590 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477592 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477595 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477599 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477602 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477611 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477614 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477617 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477620 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477622 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477625 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.480265 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477628 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477630 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477633 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477636 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477638 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477641 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477644 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477646 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477649 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477651 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477654 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477656 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477659 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477661 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.477664 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.480730 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.477669 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479622 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479673 2575 feature_gate.go:328] unrecognized feature gate: DualReplica Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479826 2575 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479830 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479833 2575 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479838 2575 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479842 2575 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479846 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479850 2575 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479853 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479855 2575 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479860 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479863 2575 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479865 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479868 2575 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479872 2575 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479875 2575 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479878 2575 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479881 2575 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jun 12 18:21:49.481097 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479885 2575 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479887 2575 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479890 2575 feature_gate.go:328] unrecognized feature gate: EventTTL Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479894 2575 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479897 2575 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479899 2575 feature_gate.go:328] unrecognized feature gate: OSStreams Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479903 2575 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479907 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479909 2575 feature_gate.go:328] unrecognized feature gate: Example2 Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479912 2575 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479915 2575 feature_gate.go:328] unrecognized feature gate: SignatureStores Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479918 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479921 2575 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479924 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479928 2575 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479931 2575 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479933 2575 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479936 2575 feature_gate.go:328] unrecognized feature gate: OVNObservability Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479940 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jun 12 18:21:49.481585 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479945 2575 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479950 2575 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479954 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479957 2575 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479961 2575 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479964 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479969 2575 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479972 2575 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479975 2575 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479978 2575 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479982 2575 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479985 2575 feature_gate.go:328] unrecognized feature gate: NewOLM Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479989 2575 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479992 2575 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479996 2575 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.479999 2575 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480002 2575 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480005 2575 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480008 2575 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480011 2575 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jun 12 18:21:49.482084 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480015 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480017 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480020 2575 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480023 2575 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480025 2575 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480028 2575 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480031 2575 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480033 2575 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480036 2575 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480040 2575 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480043 2575 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480047 2575 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480051 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480054 2575 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480056 2575 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480060 2575 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480063 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480065 2575 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480068 2575 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480072 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jun 12 18:21:49.482782 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480075 2575 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480078 2575 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480082 2575 feature_gate.go:328] unrecognized feature gate: Example Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480085 2575 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480089 2575 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480093 2575 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480096 2575 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480099 2575 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480103 2575 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480108 2575 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480111 2575 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480115 2575 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480119 2575 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480122 2575 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480125 2575 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480129 2575 feature_gate.go:328] unrecognized feature gate: PinnedImages Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480133 2575 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480137 2575 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480141 2575 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480144 2575 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jun 12 18:21:49.483266 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:49.480146 2575 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jun 12 18:21:49.483753 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.480153 2575 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jun 12 18:21:49.483753 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.480299 2575 server.go:962] "Client rotation is on, will bootstrap in background" Jun 12 18:21:49.483753 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.482447 2575 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jun 12 18:21:49.483921 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.483908 2575 server.go:1019] "Starting client certificate rotation" Jun 12 18:21:49.484032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.484016 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:21:49.484070 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.484047 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jun 12 18:21:49.486871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.486854 2575 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:21:49.490869 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.490840 2575 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jun 12 18:21:49.504178 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.504151 2575 log.go:25] "Validated CRI v1 runtime API" Jun 12 18:21:49.507149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.507135 2575 log.go:25] "Validated CRI v1 image API" Jun 12 18:21:49.507948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.507930 2575 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jun 12 18:21:49.513030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.513006 2575 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 c23bcf25-df69-4641-96de-07b8f4933302:/dev/nvme0n1p3 eba9b3eb-f602-4ab4-87db-c3dfc0c2f5c3:/dev/nvme0n1p4] Jun 12 18:21:49.513103 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.513030 2575 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jun 12 18:21:49.519225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.519069 2575 manager.go:216] Machine: {Timestamp:2026-06-12 18:21:49.517451084 +0000 UTC m=+0.373817978 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3070027 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec20933dcc6dc1e82e36ba7213096dbe SystemUUID:ec20933d-cc6d-c1e8-2e36-ba7213096dbe BootID:c3753400-d038-4b64-a656-8287d435dfb2 Filesystems:[{Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:30:59:70:9e:a3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:30:59:70:9e:a3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:56:7b:44:d7:5a:56 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jun 12 18:21:49.519225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.519220 2575 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jun 12 18:21:49.519353 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.519331 2575 manager.go:232] Version: {KernelVersion:5.14.0-570.120.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260608-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jun 12 18:21:49.522539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.522522 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:21:49.522691 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.522640 2575 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jun 12 18:21:49.522843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.522683 2575 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-101.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jun 12 18:21:49.523500 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.523489 2575 topology_manager.go:138] "Creating topology manager with none policy" Jun 12 18:21:49.523537 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.523502 2575 container_manager_linux.go:309] "Creating device plugin manager" Jun 12 18:21:49.523537 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.523510 2575 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:21:49.525603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.525586 2575 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jun 12 18:21:49.530043 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.526950 2575 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jun 12 18:21:49.530133 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530058 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:21:49.530404 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530392 2575 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jun 12 18:21:49.530446 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530428 2575 kubelet.go:486] "Attempting to sync node with API server" Jun 12 18:21:49.530446 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530439 2575 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jun 12 18:21:49.530496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530453 2575 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jun 12 18:21:49.530496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530464 2575 kubelet.go:398] "Adding apiserver pod source" Jun 12 18:21:49.530496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530475 2575 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jun 12 18:21:49.530873 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530860 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:21:49.530929 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.530880 2575 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jun 12 18:21:49.531589 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.531570 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lffs5" Jun 12 18:21:49.533160 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.533141 2575 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jun 12 18:21:49.534961 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.534948 2575 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jun 12 18:21:49.534999 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.534978 2575 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jun 12 18:21:49.535748 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535737 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jun 12 18:21:49.535783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535754 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jun 12 18:21:49.535783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535761 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jun 12 18:21:49.535783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535771 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jun 12 18:21:49.535783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535782 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jun 12 18:21:49.535885 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535790 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jun 12 18:21:49.535998 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535989 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jun 12 18:21:49.536030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.535999 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jun 12 18:21:49.536030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536007 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jun 12 18:21:49.536030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536012 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jun 12 18:21:49.536030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536021 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jun 12 18:21:49.536030 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536028 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jun 12 18:21:49.536838 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536826 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jun 12 18:21:49.536872 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.536840 2575 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jun 12 18:21:49.538780 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.538764 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-lffs5" Jun 12 18:21:49.540238 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.540223 2575 server.go:1268] "Started kubelet" Jun 12 18:21:49.540564 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.540492 2575 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jun 12 18:21:49.540638 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.540586 2575 server_v1.go:49] "podresources" method="list" useActivePods=true Jun 12 18:21:49.540638 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.540458 2575 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jun 12 18:21:49.541186 ip-10-0-138-101 systemd[1]: Started Kubernetes Kubelet. Jun 12 18:21:49.551225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.545465 2575 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jun 12 18:21:49.551225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.547676 2575 server.go:310] "Adding debug handlers to kubelet server" Jun 12 18:21:49.551225 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.549196 2575 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jun 12 18:21:49.551225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.549259 2575 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-101.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jun 12 18:21:49.551225 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.550524 2575 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jun 12 18:21:49.552380 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.552366 2575 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:49.554918 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.554902 2575 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jun 12 18:21:49.554918 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.554911 2575 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jun 12 18:21:49.555011 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.554989 2575 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-101.ec2.internal\" not found" Jun 12 18:21:49.555585 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.555553 2575 volume_manager.go:311] "The desired_state_of_world populator starts" Jun 12 18:21:49.555585 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.555570 2575 volume_manager.go:313] "Starting Kubelet Volume Manager" Jun 12 18:21:49.555746 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.555590 2575 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jun 12 18:21:49.555746 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.555712 2575 reconstruct.go:97] "Volume reconstruction finished" Jun 12 18:21:49.555746 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.555720 2575 reconciler.go:29] "Reconciler: start to sync state" Jun 12 18:21:49.556072 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556062 2575 factory.go:55] Registering systemd factory Jun 12 18:21:49.556121 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556079 2575 factory.go:223] Registration of the systemd container factory successfully Jun 12 18:21:49.556388 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556369 2575 factory.go:153] Registering CRI-O factory Jun 12 18:21:49.556388 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556388 2575 factory.go:223] Registration of the crio container factory successfully Jun 12 18:21:49.556535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556441 2575 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jun 12 18:21:49.556535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556468 2575 factory.go:103] Registering Raw factory Jun 12 18:21:49.556535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556484 2575 manager.go:1196] Started watching for new ooms in manager Jun 12 18:21:49.556925 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.556913 2575 manager.go:349] Starting recovery of all containers Jun 12 18:21:49.557046 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.557028 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:49.564164 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.564143 2575 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-101.ec2.internal\" not found" node="ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.570569 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.570549 2575 manager.go:354] Recovery completed Jun 12 18:21:49.574916 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.574867 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:49.577375 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577291 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:49.577375 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577327 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:49.577375 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577354 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:49.577919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577855 2575 cpu_manager.go:222] "Starting CPU manager" policy="none" Jun 12 18:21:49.577919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577869 2575 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jun 12 18:21:49.577919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577891 2575 state_mem.go:36] "Initialized new in-memory state store" Jun 12 18:21:49.577919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.577893 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:49.578532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.578518 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:49.578588 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.578540 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:49.578588 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.578553 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:49.579084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.579068 2575 policy_none.go:49] "None policy: Start" Jun 12 18:21:49.579143 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.579088 2575 memory_manager.go:187] "Starting memorymanager" policy="None" Jun 12 18:21:49.579143 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.579102 2575 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jun 12 18:21:49.580167 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.580154 2575 policy_none.go:47] "Start" Jun 12 18:21:49.615130 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615108 2575 manager.go:337] "Starting Device Plugin manager" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.615156 2575 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615168 2575 server.go:87] "Starting device plugin registration server" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615462 2575 eviction_manager.go:189] "Eviction manager: starting control loop" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615474 2575 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615558 2575 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615632 2575 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.615637 2575 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.616808 2575 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.617140 2575 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-101.ec2.internal\" not found" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.627869 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.629262 2575 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.629305 2575 status_manager.go:244] "Starting to sync pod status with apiserver" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.629329 2575 kubelet.go:2448] "Starting kubelet main sync loop" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.629385 2575 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jun 12 18:21:49.631048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.630920 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:49.716669 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.716578 2575 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jun 12 18:21:49.717800 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.717783 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientMemory" Jun 12 18:21:49.717886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.717815 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasNoDiskPressure" Jun 12 18:21:49.717886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.717826 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeHasSufficientPID" Jun 12 18:21:49.717886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.717852 2575 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.726925 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.726901 2575 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.730381 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.730355 2575 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"] Jun 12 18:21:49.731813 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.731796 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.732673 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.732654 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.755425 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.755399 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.762203 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.762179 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.766657 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.766638 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.772330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.772314 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:49.773402 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.773388 2575 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.776686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.776670 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:49.776738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.776682 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:49.776738 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.776719 2575 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" already exists" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.784323 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.784307 2575 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jun 12 18:21:49.784396 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:49.784360 2575 kubelet.go:3250] "Failed creating a mirror pod" err="pods \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" already exists" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.856635 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.856600 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.856635 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.856633 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.856819 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.856654 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382dde081b011bba9174dc4bb8126861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"382dde081b011bba9174dc4bb8126861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956786 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956786 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956787 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956827 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382dde081b011bba9174dc4bb8126861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"382dde081b011bba9174dc4bb8126861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956854 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956875 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6ef31e4b80d8b98eac3c9dcdf65d28ba-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal\" (UID: \"6ef31e4b80d8b98eac3c9dcdf65d28ba\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:49.956963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:49.956886 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/382dde081b011bba9174dc4bb8126861-config\") pod \"kube-apiserver-proxy-ip-10-0-138-101.ec2.internal\" (UID: \"382dde081b011bba9174dc4bb8126861\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:50.080054 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.079964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" Jun 12 18:21:50.080188 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.079963 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" Jun 12 18:21:50.482985 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.482948 2575 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jun 12 18:21:50.483682 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.483119 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:21:50.483682 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.483142 2575 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jun 12 18:21:50.530968 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.530937 2575 apiserver.go:52] "Watching apiserver" Jun 12 18:21:50.539730 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.539704 2575 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jun 12 18:21:50.541603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.541574 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-w26kp","openshift-dns/node-resolver-wwz6z","openshift-image-registry/node-ca-npvkt","openshift-multus/multus-additional-cni-plugins-npmzx","openshift-multus/multus-n8pt9","openshift-multus/network-metrics-daemon-wnh5c","kube-system/global-pull-secret-syncer-qx8fz","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal","openshift-network-diagnostics/network-check-target-pkqh7","openshift-network-operator/iptables-alerter-kmw5l","openshift-ovn-kubernetes/ovnkube-node-bt8dk","kube-system/konnectivity-agent-phr44","kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal"] Jun 12 18:21:50.542890 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.542867 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.543912 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.543890 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.544993 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.544977 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.545618 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.545600 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.545802 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.545791 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.545850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.545808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-nzgb5\"" Jun 12 18:21:50.546106 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.546089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.546604 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.546586 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.546682 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.546655 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-h464j\"" Jun 12 18:21:50.546733 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.546680 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.547148 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.547128 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-06-11 18:16:49 +0000 UTC" deadline="2027-12-19 02:50:52.106463269 +0000 UTC" Jun 12 18:21:50.547204 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.547150 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13304h29m1.559316985s" Jun 12 18:21:50.547204 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.547158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.548488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.547705 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.548488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.548211 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.548488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.548318 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jun 12 18:21:50.548745 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.548725 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.548798 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.548776 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jun 12 18:21:50.549757 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.549384 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-2gnw5\"" Jun 12 18:21:50.549757 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.549494 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-smmfz\"" Jun 12 18:21:50.549757 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.549722 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jun 12 18:21:50.549942 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.549923 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.550126 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.550109 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jun 12 18:21:50.550221 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.550180 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jun 12 18:21:50.550880 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.550557 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.550880 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.550645 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:21:50.551059 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.551041 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.551182 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.551160 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:21:50.552433 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.552416 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.552557 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.552520 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-rln9g\"" Jun 12 18:21:50.553555 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.553541 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:50.553622 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.553607 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:21:50.554628 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.554612 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jun 12 18:21:50.554628 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.554624 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-67p28\"" Jun 12 18:21:50.554720 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.554640 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.554773 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.554756 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.554897 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.554885 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.555088 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.555073 2575 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jun 12 18:21:50.557386 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.557369 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jun 12 18:21:50.557386 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.557382 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.557637 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.557623 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.557907 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.557894 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-gkq9d\"" Jun 12 18:21:50.559231 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559212 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.559770 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559747 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.559848 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559784 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84pxg\" (UniqueName: \"kubernetes.io/projected/4f1ec862-6e8e-4455-8cb2-963c4f804b84-kube-api-access-84pxg\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.559848 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559812 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8fffk\" (UniqueName: \"kubernetes.io/projected/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-kube-api-access-8fffk\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.559848 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559835 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-netns\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.559940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559859 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fww5r\" (UniqueName: \"kubernetes.io/projected/a185510c-61d3-4ac2-ba4c-406dff6e9b16-kube-api-access-fww5r\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.559940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559883 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36719154-4559-4827-adb7-d391216b5b35-iptables-alerter-script\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.559940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-systemd-units\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.559940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559930 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559953 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-systemd\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.559997 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4x88b\" (UniqueName: \"kubernetes.io/projected/6391b6d3-45a0-4091-a618-49bb943fec3b-kube-api-access-4x88b\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560045 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-host\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560067 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-dbus\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560087 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.560114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560111 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-kubelet\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560135 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-script-lib\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560158 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-tuned\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cni-binary-copy\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560207 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-daemon-config\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560242 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-etc-kubernetes\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560257 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-device-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560275 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560297 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-cnibin\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.560359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-netns\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560398 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-system-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560424 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-multus-certs\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560455 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-systemd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560506 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-log-socket\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560534 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-node-log\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560560 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-env-overrides\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560643 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-lib-modules\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560669 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6391b6d3-45a0-4091-a618-49bb943fec3b-hosts-file\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560692 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-conf-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560717 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.560769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-tmp\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560785 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-multus\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hqcgk\" (UniqueName: \"kubernetes.io/projected/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-kube-api-access-hqcgk\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560972 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysconfig\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.560995 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-kubernetes\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561027 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-54hnb\" (UniqueName: \"kubernetes.io/projected/6efd2e59-1317-4161-ad59-63118bc696f5-kube-api-access-54hnb\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561055 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-socket-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561080 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t484q\" (UniqueName: \"kubernetes.io/projected/9aaf8a1f-48d4-4a84-b138-99724970fc5e-kube-api-access-t484q\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561126 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-ovn\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561139 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-var-lib-kubelet\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.561176 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561163 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-serviceca\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561196 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561214 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-os-release\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-sys-fs\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561305 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-netd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561319 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-config\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561347 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cnibin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561365 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561386 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-slash\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561401 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561427 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-etc-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-bin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561462 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-hostroot\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561484 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36719154-4559-4827-adb7-d391216b5b35-host-slash\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.561539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561508 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-host\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561540 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8czj7\" (UniqueName: \"kubernetes.io/projected/36719154-4559-4827-adb7-d391216b5b35-kube-api-access-8czj7\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561561 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561571 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-var-lib-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561582 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561595 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-conf\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-socket-dir-parent\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561673 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-k8s-cni-cncf-io\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561696 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-registration-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561749 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-os-release\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561786 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-kubelet-config\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561805 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-bin\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561837 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561864 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-sys\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561873 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561902 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-kubelet\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561932 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-system-cni-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561958 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.562114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561983 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.561984 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562009 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562030 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-modprobe-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562051 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-run\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562071 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6391b6d3-45a0-4091-a618-49bb943fec3b-tmp-dir\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562100 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-47d8g\" (UniqueName: \"kubernetes.io/projected/32efa2cf-b59c-4619-9212-4f87f28c2411-kube-api-access-47d8g\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562217 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562243 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-bbrlk\"" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.562264 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jun 12 18:21:50.562769 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.562576 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6ef31e4b80d8b98eac3c9dcdf65d28ba.slice/crio-471402ec46f8db05e54e37fd82c073b0c192bcef847c5d0bbb722494a040ae62 WatchSource:0}: Error finding container 471402ec46f8db05e54e37fd82c073b0c192bcef847c5d0bbb722494a040ae62: Status 404 returned error can't find the container with id 471402ec46f8db05e54e37fd82c073b0c192bcef847c5d0bbb722494a040ae62 Jun 12 18:21:50.563070 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.563055 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jun 12 18:21:50.563155 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.563142 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-l9sf7\"" Jun 12 18:21:50.563399 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.563387 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jun 12 18:21:50.567985 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.567971 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:21:50.568390 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.568370 2575 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jun 12 18:21:50.588385 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.588311 2575 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7v4q" Jun 12 18:21:50.596461 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.596441 2575 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-q7v4q" Jun 12 18:21:50.632417 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.632367 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"6ef31e4b80d8b98eac3c9dcdf65d28ba","Type":"ContainerStarted","Data":"471402ec46f8db05e54e37fd82c073b0c192bcef847c5d0bbb722494a040ae62"} Jun 12 18:21:50.657236 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.657211 2575 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jun 12 18:21:50.662875 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cni-binary-copy\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.662991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-daemon-config\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.662991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-etc-kubernetes\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.662991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662931 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-device-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.662991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:50.662991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662977 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-cnibin\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.662997 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-etc-kubernetes\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663030 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-device-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-netns\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-netns\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-cnibin\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663125 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-system-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663180 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-system-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663199 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-multus-certs\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663232 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-systemd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663255 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-log-socket\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663276 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-multus-certs\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663281 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-node-log\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-env-overrides\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663309 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-systemd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663320 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-log-socket\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-lib-modules\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663393 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-node-log\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663429 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6391b6d3-45a0-4091-a618-49bb943fec3b-hosts-file\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663442 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-lib-modules\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663455 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-conf-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663458 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-daemon-config\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663482 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663476 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6391b6d3-45a0-4091-a618-49bb943fec3b-hosts-file\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663515 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-conf-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663526 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-tmp\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663538 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663553 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-multus\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663575 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cni-binary-copy\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hqcgk\" (UniqueName: \"kubernetes.io/projected/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-kube-api-access-hqcgk\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.663860 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663648 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-multus\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663682 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysconfig\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663712 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-kubernetes\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663741 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b9e5917-f6e4-4f0f-b815-f3012b76de10-agent-certs\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663771 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-env-overrides\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysconfig\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663795 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-kubernetes\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663768 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-54hnb\" (UniqueName: \"kubernetes.io/projected/6efd2e59-1317-4161-ad59-63118bc696f5-kube-api-access-54hnb\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663833 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-socket-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663794 2575 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663850 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t484q\" (UniqueName: \"kubernetes.io/projected/9aaf8a1f-48d4-4a84-b138-99724970fc5e-kube-api-access-t484q\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663889 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-ovn\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663905 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-var-lib-kubelet\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663936 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-serviceca\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663953 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-socket-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663967 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-ovn\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.664662 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663997 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-os-release\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.663979 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-var-lib-kubelet\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664008 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-cni-dir\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664081 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-os-release\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664075 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-sys-fs\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664121 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-etc-selinux\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664128 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-netd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664174 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-sys-fs\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664197 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-config\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664213 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-netd\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664220 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cnibin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664277 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-slash\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664302 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664325 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-etc-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.665285 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664360 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-cnibin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664401 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-bin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-slash\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-serviceca\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664454 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-run-ovn-kubernetes\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664362 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-cni-bin\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664474 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-binary-copy\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664489 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-hostroot\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664492 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-etc-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664435 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-kubelet-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664508 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36719154-4559-4827-adb7-d391216b5b35-host-slash\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664558 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-hostroot\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664597 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-host\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664609 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/36719154-4559-4827-adb7-d391216b5b35-host-slash\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664630 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8czj7\" (UniqueName: \"kubernetes.io/projected/36719154-4559-4827-adb7-d391216b5b35-kube-api-access-8czj7\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664644 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-host\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664656 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-var-lib-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664678 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-conf\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.666171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664713 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-var-lib-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664715 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b9e5917-f6e4-4f0f-b815-f3012b76de10-konnectivity-ca\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-config\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664645 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664774 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-socket-dir-parent\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664801 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-k8s-cni-cncf-io\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664824 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-registration-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664830 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-multus-socket-dir-parent\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664827 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-conf\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-os-release\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664842 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-k8s-cni-cncf-io\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664866 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/32efa2cf-b59c-4619-9212-4f87f28c2411-registration-dir\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664870 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-kubelet-config\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664904 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-os-release\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664904 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-bin\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664930 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-cni-bin\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664900 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-kubelet-config\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.667032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664943 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664958 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-sys\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.664972 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-kubelet\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665008 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-system-cni-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665021 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-var-lib-kubelet\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-system-cni-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665066 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-sys\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665069 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-sysctl-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665096 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665115 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665133 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-modprobe-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665151 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-run\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665176 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/6efd2e59-1317-4161-ad59-63118bc696f5-tuning-conf-dir\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665181 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6391b6d3-45a0-4091-a618-49bb943fec3b-tmp-dir\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-47d8g\" (UniqueName: \"kubernetes.io/projected/32efa2cf-b59c-4619-9212-4f87f28c2411-kube-api-access-47d8g\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665259 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.667686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665279 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-modprobe-d\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665304 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84pxg\" (UniqueName: \"kubernetes.io/projected/4f1ec862-6e8e-4455-8cb2-963c4f804b84-kube-api-access-84pxg\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665330 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8fffk\" (UniqueName: \"kubernetes.io/projected/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-kube-api-access-8fffk\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665369 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-netns\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.665373 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665394 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww5r\" (UniqueName: \"kubernetes.io/projected/a185510c-61d3-4ac2-ba4c-406dff6e9b16-kube-api-access-fww5r\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665418 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36719154-4559-4827-adb7-d391216b5b35-iptables-alerter-script\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.665446 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:21:51.165413695 +0000 UTC m=+2.021780602 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665476 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-systemd-units\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665501 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665531 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6391b6d3-45a0-4091-a618-49bb943fec3b-tmp-dir\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665525 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-systemd\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665579 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4x88b\" (UniqueName: \"kubernetes.io/projected/6391b6d3-45a0-4091-a618-49bb943fec3b-kube-api-access-4x88b\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665602 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-host\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665626 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-run\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-dbus\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665640 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/6efd2e59-1317-4161-ad59-63118bc696f5-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.668170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665661 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-run-openvswitch\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665707 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-kubelet\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/43267e23-e06f-44da-a07a-68d62c30f653-dbus\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665766 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-script-lib\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665792 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-tuned\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.665812 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.665881 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:51.165863641 +0000 UTC m=+2.022230544 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665898 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/a185510c-61d3-4ac2-ba4c-406dff6e9b16-host-run-netns\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665929 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-host-kubelet\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665812 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-host\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665964 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/36719154-4559-4827-adb7-d391216b5b35-iptables-alerter-script\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.665986 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-systemd-units\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.666046 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-systemd\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.666410 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovnkube-script-lib\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.667216 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-tmp\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.667750 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4f1ec862-6e8e-4455-8cb2-963c4f804b84-etc-tuned\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.668653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.667780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-ovn-node-metrics-cert\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.673369 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.673318 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:50.673369 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.673361 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:50.673507 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.673375 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:50.673507 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:50.673435 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:51.173417965 +0000 UTC m=+2.029784866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:50.675031 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.674667 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hqcgk\" (UniqueName: \"kubernetes.io/projected/3bbd1cba-5ee5-496a-8cc9-678bfc147e2e-kube-api-access-hqcgk\") pod \"ovnkube-node-bt8dk\" (UID: \"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e\") " pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.675031 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.674992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t484q\" (UniqueName: \"kubernetes.io/projected/9aaf8a1f-48d4-4a84-b138-99724970fc5e-kube-api-access-t484q\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:50.676005 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.675927 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-54hnb\" (UniqueName: \"kubernetes.io/projected/6efd2e59-1317-4161-ad59-63118bc696f5-kube-api-access-54hnb\") pod \"multus-additional-cni-plugins-npmzx\" (UID: \"6efd2e59-1317-4161-ad59-63118bc696f5\") " pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.676710 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.676684 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4x88b\" (UniqueName: \"kubernetes.io/projected/6391b6d3-45a0-4091-a618-49bb943fec3b-kube-api-access-4x88b\") pod \"node-resolver-wwz6z\" (UID: \"6391b6d3-45a0-4091-a618-49bb943fec3b\") " pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.676919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.676896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8czj7\" (UniqueName: \"kubernetes.io/projected/36719154-4559-4827-adb7-d391216b5b35-kube-api-access-8czj7\") pod \"iptables-alerter-kmw5l\" (UID: \"36719154-4559-4827-adb7-d391216b5b35\") " pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.677649 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.677628 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-84pxg\" (UniqueName: \"kubernetes.io/projected/4f1ec862-6e8e-4455-8cb2-963c4f804b84-kube-api-access-84pxg\") pod \"tuned-w26kp\" (UID: \"4f1ec862-6e8e-4455-8cb2-963c4f804b84\") " pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.677790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.677775 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8fffk\" (UniqueName: \"kubernetes.io/projected/9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc-kube-api-access-8fffk\") pod \"node-ca-npvkt\" (UID: \"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc\") " pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.677987 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.677966 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fww5r\" (UniqueName: \"kubernetes.io/projected/a185510c-61d3-4ac2-ba4c-406dff6e9b16-kube-api-access-fww5r\") pod \"multus-n8pt9\" (UID: \"a185510c-61d3-4ac2-ba4c-406dff6e9b16\") " pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.678124 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.678107 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-47d8g\" (UniqueName: \"kubernetes.io/projected/32efa2cf-b59c-4619-9212-4f87f28c2411-kube-api-access-47d8g\") pod \"aws-ebs-csi-driver-node-fqbhp\" (UID: \"32efa2cf-b59c-4619-9212-4f87f28c2411\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.700963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.700606 2575 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:50.766461 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.766387 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b9e5917-f6e4-4f0f-b815-f3012b76de10-agent-certs\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.766461 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.766434 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b9e5917-f6e4-4f0f-b815-f3012b76de10-konnectivity-ca\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.767009 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.766985 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/0b9e5917-f6e4-4f0f-b815-f3012b76de10-konnectivity-ca\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.768620 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.768599 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/0b9e5917-f6e4-4f0f-b815-f3012b76de10-agent-certs\") pod \"konnectivity-agent-phr44\" (UID: \"0b9e5917-f6e4-4f0f-b815-f3012b76de10\") " pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.785560 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.785529 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod382dde081b011bba9174dc4bb8126861.slice/crio-4e2f3ab32215b5b74a70fc5c2f5ad42312d77835e62b54b663c847ce18cc2483 WatchSource:0}: Error finding container 4e2f3ab32215b5b74a70fc5c2f5ad42312d77835e62b54b663c847ce18cc2483: Status 404 returned error can't find the container with id 4e2f3ab32215b5b74a70fc5c2f5ad42312d77835e62b54b663c847ce18cc2483 Jun 12 18:21:50.873048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.873013 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-w26kp" Jun 12 18:21:50.878683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.878564 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-wwz6z" Jun 12 18:21:50.881118 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.881095 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f1ec862_6e8e_4455_8cb2_963c4f804b84.slice/crio-8048fb5526aca896cb1f93a8c6b232949d2beb19d27ed6e29eec8e8259f6ef85 WatchSource:0}: Error finding container 8048fb5526aca896cb1f93a8c6b232949d2beb19d27ed6e29eec8e8259f6ef85: Status 404 returned error can't find the container with id 8048fb5526aca896cb1f93a8c6b232949d2beb19d27ed6e29eec8e8259f6ef85 Jun 12 18:21:50.885596 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.885577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-npvkt" Jun 12 18:21:50.885909 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.885891 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6391b6d3_45a0_4091_a618_49bb943fec3b.slice/crio-d67c5330022aff1847fd88b74a2a8c65b22d76264bf3d2f03d1cd44b10508c57 WatchSource:0}: Error finding container d67c5330022aff1847fd88b74a2a8c65b22d76264bf3d2f03d1cd44b10508c57: Status 404 returned error can't find the container with id d67c5330022aff1847fd88b74a2a8c65b22d76264bf3d2f03d1cd44b10508c57 Jun 12 18:21:50.889410 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.889385 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-npmzx" Jun 12 18:21:50.894173 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.894143 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d7ee0f1_0621_4eaa_80e1_64c6b36e43dc.slice/crio-3585f116360638289ceff4add70412dcb2266bb56be10a7421b8ffd406149d1e WatchSource:0}: Error finding container 3585f116360638289ceff4add70412dcb2266bb56be10a7421b8ffd406149d1e: Status 404 returned error can't find the container with id 3585f116360638289ceff4add70412dcb2266bb56be10a7421b8ffd406149d1e Jun 12 18:21:50.894982 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.894964 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-n8pt9" Jun 12 18:21:50.898377 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.898350 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6efd2e59_1317_4161_ad59_63118bc696f5.slice/crio-c89c277eabffe1f83de7ff0517b53433043ce93fcaa17706a307c42ecedf5295 WatchSource:0}: Error finding container c89c277eabffe1f83de7ff0517b53433043ce93fcaa17706a307c42ecedf5295: Status 404 returned error can't find the container with id c89c277eabffe1f83de7ff0517b53433043ce93fcaa17706a307c42ecedf5295 Jun 12 18:21:50.900533 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.900515 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" Jun 12 18:21:50.903408 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.903387 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda185510c_61d3_4ac2_ba4c_406dff6e9b16.slice/crio-bd5bac4d503b0e30dfc10a5ff0d7d9c2c7568a418ed3aae9ea411ec441fcf8ce WatchSource:0}: Error finding container bd5bac4d503b0e30dfc10a5ff0d7d9c2c7568a418ed3aae9ea411ec441fcf8ce: Status 404 returned error can't find the container with id bd5bac4d503b0e30dfc10a5ff0d7d9c2c7568a418ed3aae9ea411ec441fcf8ce Jun 12 18:21:50.907698 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.907680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kmw5l" Jun 12 18:21:50.908691 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.908666 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32efa2cf_b59c_4619_9212_4f87f28c2411.slice/crio-dcd38676b1c02abb5f5857de6e624a6aea11f7d2a3196ee41ab913fcf69285c9 WatchSource:0}: Error finding container dcd38676b1c02abb5f5857de6e624a6aea11f7d2a3196ee41ab913fcf69285c9: Status 404 returned error can't find the container with id dcd38676b1c02abb5f5857de6e624a6aea11f7d2a3196ee41ab913fcf69285c9 Jun 12 18:21:50.913516 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.913495 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:21:50.915631 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.915607 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36719154_4559_4827_adb7_d391216b5b35.slice/crio-af796b6aad840abc57f5bcc7ad3ff7375bf517e1d9452729cc7bc4ae1cb71b76 WatchSource:0}: Error finding container af796b6aad840abc57f5bcc7ad3ff7375bf517e1d9452729cc7bc4ae1cb71b76: Status 404 returned error can't find the container with id af796b6aad840abc57f5bcc7ad3ff7375bf517e1d9452729cc7bc4ae1cb71b76 Jun 12 18:21:50.917441 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:50.917414 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:21:50.924370 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.924327 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bbd1cba_5ee5_496a_8cc9_678bfc147e2e.slice/crio-fa97319de35b71233bfb25db0b0b3581e8fbd379d2096600b8a570bb00c70dcb WatchSource:0}: Error finding container fa97319de35b71233bfb25db0b0b3581e8fbd379d2096600b8a570bb00c70dcb: Status 404 returned error can't find the container with id fa97319de35b71233bfb25db0b0b3581e8fbd379d2096600b8a570bb00c70dcb Jun 12 18:21:50.924965 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:21:50.924944 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b9e5917_f6e4_4f0f_b815_f3012b76de10.slice/crio-988e532da6711cefe26f904489a18b0bee55b0ce749eed65fd48528a742bc730 WatchSource:0}: Error finding container 988e532da6711cefe26f904489a18b0bee55b0ce749eed65fd48528a742bc730: Status 404 returned error can't find the container with id 988e532da6711cefe26f904489a18b0bee55b0ce749eed65fd48528a742bc730 Jun 12 18:21:51.168747 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.168657 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:51.168747 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.168702 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:51.168951 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.168805 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:51.168951 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.168820 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:51.168951 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.168873 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:21:52.168857876 +0000 UTC m=+3.025224758 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:51.168951 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.168887 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:52.168881129 +0000 UTC m=+3.025248008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:51.269581 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.269537 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:51.269761 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.269693 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:51.269761 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.269723 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:51.269761 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.269738 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:51.269924 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.269803 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:52.269785304 +0000 UTC m=+3.126152180 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:51.360404 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.359969 2575 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:51.600054 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.599699 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:16:50 +0000 UTC" deadline="2027-11-15 05:59:41.108900366 +0000 UTC" Jun 12 18:21:51.600054 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.599961 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12491h37m49.508944138s" Jun 12 18:21:51.633377 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.632718 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:51.633377 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:51.632840 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:21:51.653199 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.653109 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phr44" event={"ID":"0b9e5917-f6e4-4f0f-b815-f3012b76de10","Type":"ContainerStarted","Data":"988e532da6711cefe26f904489a18b0bee55b0ce749eed65fd48528a742bc730"} Jun 12 18:21:51.671280 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.671013 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"fa97319de35b71233bfb25db0b0b3581e8fbd379d2096600b8a570bb00c70dcb"} Jun 12 18:21:51.680571 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.680530 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kmw5l" event={"ID":"36719154-4559-4827-adb7-d391216b5b35","Type":"ContainerStarted","Data":"af796b6aad840abc57f5bcc7ad3ff7375bf517e1d9452729cc7bc4ae1cb71b76"} Jun 12 18:21:51.707879 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.707834 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerStarted","Data":"c89c277eabffe1f83de7ff0517b53433043ce93fcaa17706a307c42ecedf5295"} Jun 12 18:21:51.728929 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.728890 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npvkt" event={"ID":"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc","Type":"ContainerStarted","Data":"3585f116360638289ceff4add70412dcb2266bb56be10a7421b8ffd406149d1e"} Jun 12 18:21:51.747225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.747118 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w26kp" event={"ID":"4f1ec862-6e8e-4455-8cb2-963c4f804b84","Type":"ContainerStarted","Data":"8048fb5526aca896cb1f93a8c6b232949d2beb19d27ed6e29eec8e8259f6ef85"} Jun 12 18:21:51.778564 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.778478 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" event={"ID":"32efa2cf-b59c-4619-9212-4f87f28c2411","Type":"ContainerStarted","Data":"dcd38676b1c02abb5f5857de6e624a6aea11f7d2a3196ee41ab913fcf69285c9"} Jun 12 18:21:51.793869 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.793684 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8pt9" event={"ID":"a185510c-61d3-4ac2-ba4c-406dff6e9b16","Type":"ContainerStarted","Data":"bd5bac4d503b0e30dfc10a5ff0d7d9c2c7568a418ed3aae9ea411ec441fcf8ce"} Jun 12 18:21:51.813486 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.813424 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwz6z" event={"ID":"6391b6d3-45a0-4091-a618-49bb943fec3b","Type":"ContainerStarted","Data":"d67c5330022aff1847fd88b74a2a8c65b22d76264bf3d2f03d1cd44b10508c57"} Jun 12 18:21:51.832126 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.832084 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" event={"ID":"382dde081b011bba9174dc4bb8126861","Type":"ContainerStarted","Data":"4e2f3ab32215b5b74a70fc5c2f5ad42312d77835e62b54b663c847ce18cc2483"} Jun 12 18:21:51.949517 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:51.949464 2575 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jun 12 18:21:52.178257 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.178173 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:52.178257 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.178228 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:52.178477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.178380 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:52.178477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.178449 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.178430722 +0000 UTC m=+5.034797607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:52.178615 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.178502 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:52.178615 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.178573 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.178553297 +0000 UTC m=+5.034920179 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:52.279120 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.278949 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:52.279304 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.279138 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:52.279304 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.279163 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:52.279304 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.279176 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:52.279304 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.279237 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:54.279218356 +0000 UTC m=+5.135585237 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:52.600183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.600070 2575 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-06-11 18:16:50 +0000 UTC" deadline="2027-11-26 17:44:04.700327815 +0000 UTC" Jun 12 18:21:52.600183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.600132 2575 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12767h22m12.100199765s" Jun 12 18:21:52.629761 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.629729 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:52.629954 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.629864 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:21:52.630291 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:52.630268 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:52.630421 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:52.630401 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:21:53.632192 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:53.632158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:53.632648 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:53.632302 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:21:54.194302 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:54.194262 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:54.194496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:54.194322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:54.194580 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.194498 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:54.194580 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.194558 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:58.194540891 +0000 UTC m=+9.050907774 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:54.194691 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.194621 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:54.194691 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.194652 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:21:58.194640697 +0000 UTC m=+9.051007573 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:54.295185 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:54.295147 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:54.295482 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.295354 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:54.295482 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.295380 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:54.295482 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.295392 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:54.295482 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.295458 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:21:58.295436512 +0000 UTC m=+9.151803402 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:54.631219 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:54.630428 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:54.631219 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.630565 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:21:54.631219 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:54.630988 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:54.631219 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:54.631098 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:21:55.631175 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:55.630670 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:55.631175 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:55.630803 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:21:56.630010 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:56.629974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:56.630177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:56.630015 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:56.630177 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:56.630116 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:21:56.630305 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:56.630253 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:21:57.630270 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:57.630230 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:57.630736 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:57.630385 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:21:58.229904 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:58.229866 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:58.230088 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:58.229919 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:58.230088 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.230039 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:58.230223 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.230122 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:22:06.230101953 +0000 UTC m=+17.086468838 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:21:58.230223 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.230050 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:58.230223 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.230189 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:06.230175018 +0000 UTC m=+17.086541899 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:21:58.331345 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:58.331303 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:58.331519 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.331483 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:21:58.331519 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.331511 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:21:58.331628 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.331525 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:58.331628 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.331598 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:06.331577494 +0000 UTC m=+17.187944382 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:21:58.630075 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:58.629992 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:21:58.630075 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:58.629990 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:21:58.630294 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.630157 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:21:58.630294 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:58.630262 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:21:59.630759 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:21:59.630577 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:21:59.630759 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:21:59.630698 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:00.630414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:00.630266 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:00.630614 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:00.630424 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:00.630614 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:00.630508 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:00.630746 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:00.630647 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:01.629655 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:01.629626 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:01.630125 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:01.629763 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:02.630244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:02.630211 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:02.630668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:02.630217 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:02.630668 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:02.630317 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:02.630668 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:02.630434 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:03.630352 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:03.630300 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:03.630807 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:03.630476 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:04.629671 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:04.629627 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:04.629853 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:04.629647 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:04.629853 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:04.629791 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:04.629959 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:04.629856 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:05.629783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:05.629748 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:05.630285 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:05.629875 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:06.295870 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:06.295825 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:06.296105 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:06.295884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:06.296105 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.296009 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:06.296105 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.296096 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:22:22.296073678 +0000 UTC m=+33.152440555 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:06.296271 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.296020 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:06.296271 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.296165 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:22.296147543 +0000 UTC m=+33.152514425 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:06.396561 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:06.396520 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:06.396755 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.396734 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:22:06.396819 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.396766 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:22:06.396819 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.396781 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:06.396893 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.396847 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:22.396828652 +0000 UTC m=+33.253195547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:06.630230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:06.630152 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:06.630669 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:06.630158 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:06.630669 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.630268 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:06.630669 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:06.630378 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:07.630354 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:07.630309 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:07.630821 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:07.630447 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:08.629801 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:08.629752 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:08.629801 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:08.629776 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:08.630055 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:08.629900 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:08.630055 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:08.630024 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:09.631099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:09.631068 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:09.631558 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:09.631180 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:10.629910 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:10.629872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:10.630096 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:10.629872 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:10.630096 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:10.630015 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:10.630096 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:10.630047 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:11.629883 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.629657 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:11.630516 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:11.629905 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:11.883763 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.883734 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-w26kp" event={"ID":"4f1ec862-6e8e-4455-8cb2-963c4f804b84","Type":"ContainerStarted","Data":"232f6fe64fbf59c80170f4a39921c64db7442269daa6dd1ddf491360ee8d0214"} Jun 12 18:22:11.887961 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.887689 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-n8pt9" event={"ID":"a185510c-61d3-4ac2-ba4c-406dff6e9b16","Type":"ContainerStarted","Data":"38ede2148adfc453db66d0cc002b0466609ad43c790a5a58693f027ba4e1015e"} Jun 12 18:22:11.889886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.889859 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" event={"ID":"382dde081b011bba9174dc4bb8126861","Type":"ContainerStarted","Data":"ba19656c9d109abc4872cf5d6d52fa44c13bde91be5aafce7449f66119d1a89c"} Jun 12 18:22:11.893687 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.893662 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:22:11.894099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894069 2575 generic.go:356] "Generic (PLEG): container finished" podID="3bbd1cba-5ee5-496a-8cc9-678bfc147e2e" containerID="e7fccd6478edc8cfb44e17bd7079b368e99ed3c9935eda2272a6c71f660f769b" exitCode=1 Jun 12 18:22:11.894184 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894113 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"99fdb95b74f694ac6b571f53d618fd4d27764f2c87b2a37acb99c6477bb824f2"} Jun 12 18:22:11.894248 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894186 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"72b5d0238656a354c43f73b231662dde4c057faba6c4026e4a0722763942de51"} Jun 12 18:22:11.894248 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894235 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"12ddc83364e503fc6d711e23d3528c8c5df430e79c1906be4a704ebb9c3dbce4"} Jun 12 18:22:11.894380 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894284 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"3fbec951b3f09cf2863ab122254fd33728c24ded7ee3cf924419b11a612ce6f7"} Jun 12 18:22:11.894380 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894331 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerDied","Data":"e7fccd6478edc8cfb44e17bd7079b368e99ed3c9935eda2272a6c71f660f769b"} Jun 12 18:22:11.894492 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.894393 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"ad6cf413ae361c12d850fd5af560cb0de90159d8fbc6c1b003d6102cd08a485b"} Jun 12 18:22:11.901028 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.900975 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-w26kp" podStartSLOduration=2.975014206 podStartE2EDuration="22.900956912s" totalImagesPullingTime="19.925942706s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:11.900954185 +0000 UTC m=+22.757321079" watchObservedRunningTime="2026-06-12 18:22:11.900956912 +0000 UTC m=+22.757323811" Jun 12 18:22:11.917717 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.917349 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-n8pt9" podStartSLOduration=2.756962748 podStartE2EDuration="22.91731787s" totalImagesPullingTime="20.160355122s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:11.916961356 +0000 UTC m=+22.773328270" watchObservedRunningTime="2026-06-12 18:22:11.91731787 +0000 UTC m=+22.773684768" Jun 12 18:22:11.931241 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:11.931198 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-101.ec2.internal" podStartSLOduration=22.931183076 podStartE2EDuration="22.931183076s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:11.93087292 +0000 UTC m=+22.787239819" watchObservedRunningTime="2026-06-12 18:22:11.931183076 +0000 UTC m=+22.787549974" Jun 12 18:22:12.630066 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.630021 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:12.630480 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:12.630131 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:12.630480 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.630182 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:12.630480 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:12.630287 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:12.899117 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.899038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-wwz6z" event={"ID":"6391b6d3-45a0-4091-a618-49bb943fec3b","Type":"ContainerStarted","Data":"d04eb7d1865f4ae37490421ca5687f82442ffbbfa5798f80e264ebe66d9afb08"} Jun 12 18:22:12.900441 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.900415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-phr44" event={"ID":"0b9e5917-f6e4-4f0f-b815-f3012b76de10","Type":"ContainerStarted","Data":"8ebf8c8c81d8bb0cbea60d6241023a3c5dfc1a8ca82ca66a41474d7f89b0fae5"} Jun 12 18:22:12.901812 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.901786 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kmw5l" event={"ID":"36719154-4559-4827-adb7-d391216b5b35","Type":"ContainerStarted","Data":"994de425c9f0f570298df77583cfe7705bd99e750c9c3f5635d70986bb76b6df"} Jun 12 18:22:12.903303 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.903277 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="ba4919d7ef10efa01a37661f415d1ac488fee2b892ae75d30cfe2002dc76d1a5" exitCode=0 Jun 12 18:22:12.903414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.903369 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"ba4919d7ef10efa01a37661f415d1ac488fee2b892ae75d30cfe2002dc76d1a5"} Jun 12 18:22:12.904779 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.904761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-npvkt" event={"ID":"9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc","Type":"ContainerStarted","Data":"e644f02328f145069c0a68b6b953dc44d716c84105f9013b7cf67096d9fbd23c"} Jun 12 18:22:12.906193 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.906136 2575 generic.go:356] "Generic (PLEG): container finished" podID="6ef31e4b80d8b98eac3c9dcdf65d28ba" containerID="a50e672727a6314b57d4ea0997bbf655746e56f0d88d552021dbb0e0a94a0091" exitCode=0 Jun 12 18:22:12.906254 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.906239 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"6ef31e4b80d8b98eac3c9dcdf65d28ba","Type":"ContainerDied","Data":"a50e672727a6314b57d4ea0997bbf655746e56f0d88d552021dbb0e0a94a0091"} Jun 12 18:22:12.907868 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.907844 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" event={"ID":"32efa2cf-b59c-4619-9212-4f87f28c2411","Type":"ContainerStarted","Data":"391c03bab82a8c70d947537f721e3c2b01fe09d5ebbf378b192f706980d22227"} Jun 12 18:22:12.915181 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.915129 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-wwz6z" podStartSLOduration=4.280629365 podStartE2EDuration="23.915113624s" totalImagesPullingTime="19.634484259s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:12.915017194 +0000 UTC m=+23.771384094" watchObservedRunningTime="2026-06-12 18:22:12.915113624 +0000 UTC m=+23.771480526" Jun 12 18:22:12.930872 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.930830 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kmw5l" podStartSLOduration=4.040901518 podStartE2EDuration="23.930816343s" totalImagesPullingTime="19.889914825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:12.930635806 +0000 UTC m=+23.787002707" watchObservedRunningTime="2026-06-12 18:22:12.930816343 +0000 UTC m=+23.787183242" Jun 12 18:22:12.960930 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.960854 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-phr44" podStartSLOduration=4.36548342 podStartE2EDuration="23.960833368s" totalImagesPullingTime="19.595349948s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:12.960179197 +0000 UTC m=+23.816546097" watchObservedRunningTime="2026-06-12 18:22:12.960833368 +0000 UTC m=+23.817200271" Jun 12 18:22:12.981636 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:12.981589 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-npvkt" podStartSLOduration=8.076706848 podStartE2EDuration="23.981573447s" totalImagesPullingTime="15.904866599s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:12.981482554 +0000 UTC m=+23.837849452" watchObservedRunningTime="2026-06-12 18:22:12.981573447 +0000 UTC m=+23.837940346" Jun 12 18:22:13.162786 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.162761 2575 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jun 12 18:22:13.630004 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.629974 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:13.630250 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.629946 2575 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-06-12T18:22:13.16278222Z","UUID":"a31428ca-538c-4f6f-ab63-a48283de644b","Handler":null,"Name":"","Endpoint":""} Jun 12 18:22:13.630250 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:13.630086 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:13.631728 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.631706 2575 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jun 12 18:22:13.631842 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.631745 2575 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jun 12 18:22:13.914253 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.914070 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:22:13.914766 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.914730 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"9e90ba6bf0394f89fd23da186bc29944d81ced20d74f00b4b7c28ac6e3351c76"} Jun 12 18:22:13.917072 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.916999 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" event={"ID":"6ef31e4b80d8b98eac3c9dcdf65d28ba","Type":"ContainerStarted","Data":"7e2d1bcd9ed9173f61d53ba2de34ac8a0e4363ee54f125479bd4fe1c2c8882a6"} Jun 12 18:22:13.922682 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.922655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" event={"ID":"32efa2cf-b59c-4619-9212-4f87f28c2411","Type":"ContainerStarted","Data":"3248bd6e4c3d6028c6c0ac78ee9500e8288f58aeeadc66698573e096ef3bbe3b"} Jun 12 18:22:13.933036 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:13.932985 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-101.ec2.internal" podStartSLOduration=24.93296953 podStartE2EDuration="24.93296953s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:13.932399062 +0000 UTC m=+24.788765974" watchObservedRunningTime="2026-06-12 18:22:13.93296953 +0000 UTC m=+24.789336428" Jun 12 18:22:14.629716 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:14.629680 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:14.629716 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:14.629717 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:14.630008 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:14.629816 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:14.630008 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:14.629971 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:14.927240 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:14.927206 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" event={"ID":"32efa2cf-b59c-4619-9212-4f87f28c2411","Type":"ContainerStarted","Data":"0996a5e3ff177398f5b8399f171a2cb493bf65a34aa8d91c804ffddb89325064"} Jun 12 18:22:14.946314 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:14.946266 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-fqbhp" podStartSLOduration=7.634963855 podStartE2EDuration="25.94624935s" totalImagesPullingTime="18.311285495s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:14.945732127 +0000 UTC m=+25.802099028" watchObservedRunningTime="2026-06-12 18:22:14.94624935 +0000 UTC m=+25.802616248" Jun 12 18:22:15.606945 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.606858 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:22:15.608125 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.608105 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:22:15.629683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.629651 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:15.629857 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:15.629783 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:15.934912 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.934688 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:22:15.935989 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.935406 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"28a0707ca50bcbf28dc9bd53dcef84be71e60409fb0fcef36adbdc42fe54c7aa"} Jun 12 18:22:15.935989 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.935851 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:22:15.936948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.936360 2575 scope.go:117] "RemoveContainer" containerID="e7fccd6478edc8cfb44e17bd7079b368e99ed3c9935eda2272a6c71f660f769b" Jun 12 18:22:15.936948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.936535 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:15.936948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.936617 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:15.936948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.936692 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-phr44" Jun 12 18:22:15.936948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.936715 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:15.959957 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.958422 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:15.959957 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:15.958647 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:16.101767 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.101728 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:16.185252 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.185204 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:16.630547 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.630460 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:16.630705 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.630460 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:16.630705 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:16.630605 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:16.630705 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:16.630639 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:16.942777 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.942746 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:22:16.943318 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.943283 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" event={"ID":"3bbd1cba-5ee5-496a-8cc9-678bfc147e2e","Type":"ContainerStarted","Data":"f45ee0f2ef4f562c5aa20bb9a8451928a24fc91b2bebea170fa2ebb5c84656fc"} Jun 12 18:22:16.972526 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:16.972465 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" podStartSLOduration=8.043257518 podStartE2EDuration="27.9724438s" totalImagesPullingTime="19.929186282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:16.971216323 +0000 UTC m=+27.827583247" watchObservedRunningTime="2026-06-12 18:22:16.9724438 +0000 UTC m=+27.828810701" Jun 12 18:22:17.630114 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:17.630078 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:17.630296 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:17.630229 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:18.122948 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.122910 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qx8fz"] Jun 12 18:22:18.123417 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.123039 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:18.123417 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:18.123140 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:18.126379 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.126326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pkqh7"] Jun 12 18:22:18.126558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.126505 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:18.126654 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:18.126620 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:18.127562 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.127532 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnh5c"] Jun 12 18:22:18.127689 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.127675 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:18.127849 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:18.127824 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:18.948946 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.948912 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="56414678ed8f90af64c00d0d4e2574dd15f433e9ce9d0b772cebde5becca908f" exitCode=0 Jun 12 18:22:18.949094 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:18.948969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"56414678ed8f90af64c00d0d4e2574dd15f433e9ce9d0b772cebde5becca908f"} Jun 12 18:22:19.630988 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:19.630953 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:19.631491 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:19.631060 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:19.631491 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:19.631090 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:19.631491 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:19.631056 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:19.631491 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:19.631164 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:19.631491 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:19.631242 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:19.954112 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:19.954082 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="05b261b9b8535e0ef9cf49cdeea248adadc2480f9a777586cce38dbe86350646" exitCode=0 Jun 12 18:22:19.954266 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:19.954123 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"05b261b9b8535e0ef9cf49cdeea248adadc2480f9a777586cce38dbe86350646"} Jun 12 18:22:20.958610 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:20.958576 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="709d8a62abb4c30ec395bf5d6e3d193af3cc92cf4e687783524d2c3fa89171e4" exitCode=0 Jun 12 18:22:20.959215 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:20.958642 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"709d8a62abb4c30ec395bf5d6e3d193af3cc92cf4e687783524d2c3fa89171e4"} Jun 12 18:22:21.629555 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:21.629521 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:21.629759 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:21.629566 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:21.629759 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:21.629650 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:21.629759 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:21.629734 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:21.630047 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:21.629833 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:21.630047 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:21.629948 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:22.324913 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:22.324876 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:22.324913 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:22.324928 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:22.325428 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.325028 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:22.325428 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.325086 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:22:54.325070213 +0000 UTC m=+65.181437089 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : object "openshift-multus"/"metrics-daemon-secret" not registered Jun 12 18:22:22.325428 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.325102 2575 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:22.325428 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.325155 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret podName:43267e23-e06f-44da-a07a-68d62c30f653 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:54.325139091 +0000 UTC m=+65.181505981 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret") pod "global-pull-secret-syncer-qx8fz" (UID: "43267e23-e06f-44da-a07a-68d62c30f653") : object "kube-system"/"original-pull-secret" not registered Jun 12 18:22:22.426297 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:22.426266 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:22.426462 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.426413 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jun 12 18:22:22.426462 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.426427 2575 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jun 12 18:22:22.426462 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.426437 2575 projected.go:196] Error preparing data for projected volume kube-api-access-fww7d for pod openshift-network-diagnostics/network-check-target-pkqh7: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:22.426587 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:22.426485 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d podName:1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:54.42647269 +0000 UTC m=+65.282839566 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-fww7d" (UniqueName: "kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d") pod "network-check-target-pkqh7" (UID: "1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jun 12 18:22:23.629801 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.629764 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:23.630227 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.629770 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:23.630227 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:23.629881 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:22:23.630227 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:23.629973 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-qx8fz" podUID="43267e23-e06f-44da-a07a-68d62c30f653" Jun 12 18:22:23.630227 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.629775 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:23.630227 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:23.630071 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pkqh7" podUID="1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0" Jun 12 18:22:23.921503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.921476 2575 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-101.ec2.internal" event="NodeReady" Jun 12 18:22:23.921670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.921615 2575 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jun 12 18:22:23.969526 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.969492 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-cfdjx"] Jun 12 18:22:23.972868 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.972852 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:23.975423 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.975244 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jun 12 18:22:23.975528 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.975308 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5r6\"" Jun 12 18:22:23.975528 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.975323 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jun 12 18:22:23.977778 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.977757 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-7gsd5"] Jun 12 18:22:23.981535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.981514 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:23.984177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.984137 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jun 12 18:22:23.984177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.984161 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-dffzh\"" Jun 12 18:22:23.984389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.984178 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfdjx"] Jun 12 18:22:23.984557 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.984446 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jun 12 18:22:23.984557 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.984510 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jun 12 18:22:23.989462 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:23.989388 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7gsd5"] Jun 12 18:22:24.141135 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141094 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cg64v\" (UniqueName: \"kubernetes.io/projected/4692c660-7576-4e6d-b7c6-7c7b70200935-kube-api-access-cg64v\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.141293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141159 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e432100-d86d-471d-9e10-2539b77aba6f-cert\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.141293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141192 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xpmn\" (UniqueName: \"kubernetes.io/projected/2e432100-d86d-471d-9e10-2539b77aba6f-kube-api-access-9xpmn\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.141293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4692c660-7576-4e6d-b7c6-7c7b70200935-tmp-dir\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.141293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141251 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4692c660-7576-4e6d-b7c6-7c7b70200935-config-volume\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.141293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.141276 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.242568 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242456 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cg64v\" (UniqueName: \"kubernetes.io/projected/4692c660-7576-4e6d-b7c6-7c7b70200935-kube-api-access-cg64v\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.242568 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242542 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e432100-d86d-471d-9e10-2539b77aba6f-cert\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.242782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242577 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xpmn\" (UniqueName: \"kubernetes.io/projected/2e432100-d86d-471d-9e10-2539b77aba6f-kube-api-access-9xpmn\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.242782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4692c660-7576-4e6d-b7c6-7c7b70200935-tmp-dir\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.242782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242646 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4692c660-7576-4e6d-b7c6-7c7b70200935-config-volume\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.242782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242672 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.243015 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:24.242799 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:24.243015 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:24.242861 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:24.742839463 +0000 UTC m=+35.599206345 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:24.243015 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.242945 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4692c660-7576-4e6d-b7c6-7c7b70200935-tmp-dir\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.243222 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.243197 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4692c660-7576-4e6d-b7c6-7c7b70200935-config-volume\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.247137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.247113 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/2e432100-d86d-471d-9e10-2539b77aba6f-cert\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.255167 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.255140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cg64v\" (UniqueName: \"kubernetes.io/projected/4692c660-7576-4e6d-b7c6-7c7b70200935-kube-api-access-cg64v\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.255456 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.255434 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xpmn\" (UniqueName: \"kubernetes.io/projected/2e432100-d86d-471d-9e10-2539b77aba6f-kube-api-access-9xpmn\") pod \"ingress-canary-7gsd5\" (UID: \"2e432100-d86d-471d-9e10-2539b77aba6f\") " pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.292486 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.292445 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-7gsd5" Jun 12 18:22:24.748065 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:24.748025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:24.748479 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:24.748168 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:24.748479 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:24.748223 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:25.74820801 +0000 UTC m=+36.604574888 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:25.628060 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.628026 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:25.629951 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.629924 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:25.630094 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.629934 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:25.630094 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.630056 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:25.634061 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634041 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:22:25.634061 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634054 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:22:25.634245 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634050 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkx6l\"" Jun 12 18:22:25.634245 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634094 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk7mw\"" Jun 12 18:22:25.634245 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634104 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:22:25.634399 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.634390 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:22:25.691582 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.691539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:25.756052 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.756014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:25.756461 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:25.756159 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:25.756461 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:25.756216 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:27.756201047 +0000 UTC m=+38.612567926 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:25.758519 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.758488 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:25.982654 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:25.982623 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-7gsd5"] Jun 12 18:22:26.014069 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:22:26.014034 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e432100_d86d_471d_9e10_2539b77aba6f.slice/crio-360ac751a588dd94326521cdff0919b763447703cdfaf778bc9f05aeeeddc6bc WatchSource:0}: Error finding container 360ac751a588dd94326521cdff0919b763447703cdfaf778bc9f05aeeeddc6bc: Status 404 returned error can't find the container with id 360ac751a588dd94326521cdff0919b763447703cdfaf778bc9f05aeeeddc6bc Jun 12 18:22:26.977952 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:26.977695 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="2fc168d80e0e6681e2a1ec4fffa7c35e49833c86f064ea310ea6a5c1d1b048b0" exitCode=0 Jun 12 18:22:26.978412 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:26.977761 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"2fc168d80e0e6681e2a1ec4fffa7c35e49833c86f064ea310ea6a5c1d1b048b0"} Jun 12 18:22:26.979216 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:26.979194 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7gsd5" event={"ID":"2e432100-d86d-471d-9e10-2539b77aba6f","Type":"ContainerStarted","Data":"360ac751a588dd94326521cdff0919b763447703cdfaf778bc9f05aeeeddc6bc"} Jun 12 18:22:27.312394 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:27.312286 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:27.413450 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:27.413415 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:27.770602 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:27.770559 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:27.770796 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:27.770711 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:27.770796 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:27.770774 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:31.770757081 +0000 UTC m=+42.627123971 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:27.986247 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:27.986201 2575 generic.go:356] "Generic (PLEG): container finished" podID="6efd2e59-1317-4161-ad59-63118bc696f5" containerID="933e79e58f2e903dcbef82cfcfe8544eaef7c5f38c964dc862aaac8003f33660" exitCode=0 Jun 12 18:22:27.986830 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:27.986303 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerDied","Data":"933e79e58f2e903dcbef82cfcfe8544eaef7c5f38c964dc862aaac8003f33660"} Jun 12 18:22:28.992259 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:28.992224 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-npmzx" event={"ID":"6efd2e59-1317-4161-ad59-63118bc696f5","Type":"ContainerStarted","Data":"8cc72c6e2d7591be82212472c351a593f691e6e72a8d58ae6d4fa9ac8e908650"} Jun 12 18:22:28.993678 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:28.993655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-7gsd5" event={"ID":"2e432100-d86d-471d-9e10-2539b77aba6f","Type":"ContainerStarted","Data":"9edfee621f0e106c402c7ad796f8fbdd9867ab93c117ead6e9bd46e7905c73b4"} Jun 12 18:22:29.016641 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.016586 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-npmzx" podStartSLOduration=8.43173479 podStartE2EDuration="40.016570645s" totalImagesPullingTime="31.584835855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:29.015098672 +0000 UTC m=+39.871465596" watchObservedRunningTime="2026-06-12 18:22:29.016570645 +0000 UTC m=+39.872937579" Jun 12 18:22:29.030257 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.030207 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-7gsd5" podStartSLOduration=3.825003911 podStartE2EDuration="6.030192629s" totalImagesPullingTime="2.205188718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:29.029521145 +0000 UTC m=+39.885888045" watchObservedRunningTime="2026-06-12 18:22:29.030192629 +0000 UTC m=+39.886559528" Jun 12 18:22:29.121820 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.121776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.186295 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.186261 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.294214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.294125 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.354865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.354822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.412025 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.411986 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.535105 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.535075 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:29.592997 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:29.592911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:30.134252 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:30.134218 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:31.800401 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:31.800359 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:31.800792 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:31.800500 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:31.800792 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:31.800554 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:39.800538108 +0000 UTC m=+50.656904984 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:39.382489 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.382451 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8"] Jun 12 18:22:39.396941 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.396911 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8"] Jun 12 18:22:39.397119 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.397021 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.399756 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.399708 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\"" Jun 12 18:22:39.399756 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.399734 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\"" Jun 12 18:22:39.401101 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.401046 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\"" Jun 12 18:22:39.401222 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.401109 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-w2ldb\"" Jun 12 18:22:39.401222 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.401165 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\"" Jun 12 18:22:39.415348 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.415309 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw"] Jun 12 18:22:39.440503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.440465 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw"] Jun 12 18:22:39.440657 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.440572 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.443482 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.443459 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\"" Jun 12 18:22:39.553048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.553008 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.553236 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.553060 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xktjs\" (UniqueName: \"kubernetes.io/projected/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-kube-api-access-xktjs\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.553236 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.553081 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rp7ch\" (UniqueName: \"kubernetes.io/projected/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-kube-api-access-rp7ch\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.553236 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.553103 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.553236 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.553225 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-tmp\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.653943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.653917 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-tmp\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.654113 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.653962 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.654113 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.653983 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xktjs\" (UniqueName: \"kubernetes.io/projected/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-kube-api-access-xktjs\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.654113 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.654007 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rp7ch\" (UniqueName: \"kubernetes.io/projected/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-kube-api-access-rp7ch\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.654113 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.654025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.654327 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.654304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-tmp\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.657639 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.657613 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.657752 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.657694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-klusterlet-config\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.662399 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.662376 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xktjs\" (UniqueName: \"kubernetes.io/projected/60faff35-33f0-4a4c-8654-5b8f6b95f4f0-kube-api-access-xktjs\") pod \"managed-serviceaccount-addon-agent-57fbd77c58-snsk8\" (UID: \"60faff35-33f0-4a4c-8654-5b8f6b95f4f0\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.662657 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.662635 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rp7ch\" (UniqueName: \"kubernetes.io/projected/46f7f9ef-5b64-443b-8e40-8efe88cc93ad-kube-api-access-rp7ch\") pod \"klusterlet-addon-workmgr-7fffb79cf9-qhssw\" (UID: \"46f7f9ef-5b64-443b-8e40-8efe88cc93ad\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.716412 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.716375 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:22:39.749970 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.749940 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:39.856053 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.856011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:39.856218 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:39.856168 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:39.856279 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:39.856236 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:22:55.856214492 +0000 UTC m=+66.712581375 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:22:39.870598 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.870564 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8"] Jun 12 18:22:39.873855 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:22:39.873827 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod60faff35_33f0_4a4c_8654_5b8f6b95f4f0.slice/crio-5b9cf92132cea11bd745d855e408f8bdfe97a150be80ae0ec07ef4d4e932a7bb WatchSource:0}: Error finding container 5b9cf92132cea11bd745d855e408f8bdfe97a150be80ae0ec07ef4d4e932a7bb: Status 404 returned error can't find the container with id 5b9cf92132cea11bd745d855e408f8bdfe97a150be80ae0ec07ef4d4e932a7bb Jun 12 18:22:39.894890 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:39.894863 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw"] Jun 12 18:22:39.897377 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:22:39.897331 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod46f7f9ef_5b64_443b_8e40_8efe88cc93ad.slice/crio-e796c597ca1ccdd6ba218f39010d0f88827846c1fefea8094c7a28a8309fbb1d WatchSource:0}: Error finding container e796c597ca1ccdd6ba218f39010d0f88827846c1fefea8094c7a28a8309fbb1d: Status 404 returned error can't find the container with id e796c597ca1ccdd6ba218f39010d0f88827846c1fefea8094c7a28a8309fbb1d Jun 12 18:22:40.019678 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:40.019585 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerStarted","Data":"5b9cf92132cea11bd745d855e408f8bdfe97a150be80ae0ec07ef4d4e932a7bb"} Jun 12 18:22:40.020589 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:40.020568 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerStarted","Data":"e796c597ca1ccdd6ba218f39010d0f88827846c1fefea8094c7a28a8309fbb1d"} Jun 12 18:22:41.600091 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:41.600051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:41.650518 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:41.650466 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:45.040138 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.040090 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerStarted","Data":"3b9727ba7db34010a944cbf93523714bfa6871a1c1c3874d49da27d35e3b1afa"} Jun 12 18:22:45.040599 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.040186 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:45.041942 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.041908 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerStarted","Data":"5416b7e0a1c6381a5ff80c80abcd634b342847794566c319cb3f864122203011"} Jun 12 18:22:45.042075 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.041969 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" podUID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" containerName="acm-agent" probeResult="failure" output="Get \"http://10.133.0.9:8000/readyz\": dial tcp 10.133.0.9:8000: connect: connection refused" Jun 12 18:22:45.055568 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.055509 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" podStartSLOduration=1.012245823 podStartE2EDuration="6.05547804s" totalImagesPullingTime="5.043232217s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:45.0543132 +0000 UTC m=+55.910680099" watchObservedRunningTime="2026-06-12 18:22:45.05547804 +0000 UTC m=+55.911844920" Jun 12 18:22:45.068157 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:45.068109 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" podStartSLOduration=1.013074729 podStartE2EDuration="6.068092098s" totalImagesPullingTime="5.055017369s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:22:45.067858887 +0000 UTC m=+55.924225788" watchObservedRunningTime="2026-06-12 18:22:45.068092098 +0000 UTC m=+55.924458991" Jun 12 18:22:46.045249 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:46.045215 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:22:47.956166 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:47.956135 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-bt8dk" Jun 12 18:22:48.105212 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:48.105172 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:48.162856 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:48.162816 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:52.222243 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:52.222203 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:52.279646 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:52.279611 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:54.360360 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.360283 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:54.360762 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.360417 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:22:54.363099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.363071 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jun 12 18:22:54.363177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.363161 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jun 12 18:22:54.371284 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:54.371262 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:22:54.371361 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:54.371327 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:23:58.371307341 +0000 UTC m=+129.227674218 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : secret "metrics-daemon-secret" not found Jun 12 18:22:54.373479 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.373449 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/43267e23-e06f-44da-a07a-68d62c30f653-original-pull-secret\") pod \"global-pull-secret-syncer-qx8fz\" (UID: \"43267e23-e06f-44da-a07a-68d62c30f653\") " pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:54.455983 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.455942 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-qx8fz" Jun 12 18:22:54.461588 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.461564 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:54.464568 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.464550 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jun 12 18:22:54.475082 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.475054 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jun 12 18:22:54.485598 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.485568 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fww7d\" (UniqueName: \"kubernetes.io/projected/1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0-kube-api-access-fww7d\") pod \"network-check-target-pkqh7\" (UID: \"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0\") " pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:54.577748 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.577709 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-qx8fz"] Jun 12 18:22:54.581057 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:22:54.581030 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43267e23_e06f_44da_a07a_68d62c30f653.slice/crio-4884b9acb9b0ed154d470535526bd6823e9475c2043cec4e751e1fc3020daa72 WatchSource:0}: Error finding container 4884b9acb9b0ed154d470535526bd6823e9475c2043cec4e751e1fc3020daa72: Status 404 returned error can't find the container with id 4884b9acb9b0ed154d470535526bd6823e9475c2043cec4e751e1fc3020daa72 Jun 12 18:22:54.746001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.745970 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-rkx6l\"" Jun 12 18:22:54.753357 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.753310 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:22:54.872561 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:54.872511 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pkqh7"] Jun 12 18:22:54.874961 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:22:54.874935 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d69411f_d6bf_4ce8_9ccf_6dc60a1520d0.slice/crio-2da6315a2ba1bd17dc09d3574a671f463659f581a57285caa82f68cb1126b7ec WatchSource:0}: Error finding container 2da6315a2ba1bd17dc09d3574a671f463659f581a57285caa82f68cb1126b7ec: Status 404 returned error can't find the container with id 2da6315a2ba1bd17dc09d3574a671f463659f581a57285caa82f68cb1126b7ec Jun 12 18:22:55.068161 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:55.068040 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pkqh7" event={"ID":"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0","Type":"ContainerStarted","Data":"2da6315a2ba1bd17dc09d3574a671f463659f581a57285caa82f68cb1126b7ec"} Jun 12 18:22:55.069667 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:55.069638 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qx8fz" event={"ID":"43267e23-e06f-44da-a07a-68d62c30f653","Type":"ContainerStarted","Data":"4884b9acb9b0ed154d470535526bd6823e9475c2043cec4e751e1fc3020daa72"} Jun 12 18:22:55.646126 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:55.646087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:55.702463 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:55.702423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:22:55.876633 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:22:55.876595 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:22:55.876829 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:55.876733 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:22:55.876829 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:22:55.876806 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:23:27.876786006 +0000 UTC m=+98.733152886 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:23:00.086270 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:00.086177 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pkqh7" event={"ID":"1d69411f-d6bf-4ce8-9ccf-6dc60a1520d0","Type":"ContainerStarted","Data":"6fb3eed3213f422bd670f36c5b000421c82b412696e2fcd815ef5edc271bb6c5"} Jun 12 18:23:00.086744 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:00.086290 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:23:00.087753 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:00.087722 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-qx8fz" event={"ID":"43267e23-e06f-44da-a07a-68d62c30f653","Type":"ContainerStarted","Data":"b4a54f4d01eb496152eaa4a5c464f65ea31b3e13e5a4202be9968c89c1526968"} Jun 12 18:23:00.102925 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:00.102879 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pkqh7" podStartSLOduration=66.202934256 podStartE2EDuration="1m11.102865199s" totalImagesPullingTime="4.899930943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:23:00.101557878 +0000 UTC m=+70.957924772" watchObservedRunningTime="2026-06-12 18:23:00.102865199 +0000 UTC m=+70.959232079" Jun 12 18:23:00.115519 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:00.115469 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-qx8fz" podStartSLOduration=65.917833451 podStartE2EDuration="1m11.115455128s" totalImagesPullingTime="5.197621677s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:23:00.114562118 +0000 UTC m=+70.970929018" watchObservedRunningTime="2026-06-12 18:23:00.115455128 +0000 UTC m=+70.971822026" Jun 12 18:23:27.907201 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:27.907175 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:23:27.907627 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:23:27.907305 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:23:27.907627 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:23:27.907383 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:24:31.907366185 +0000 UTC m=+162.763733063 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:23:31.093697 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:31.093666 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pkqh7" Jun 12 18:23:58.428600 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:23:58.428547 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:23:58.429101 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:23:58.428695 2575 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jun 12 18:23:58.429101 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:23:58.428759 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs podName:9aaf8a1f-48d4-4a84-b138-99724970fc5e nodeName:}" failed. No retries permitted until 2026-06-12 18:26:00.428744285 +0000 UTC m=+251.285111167 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs") pod "network-metrics-daemon-wnh5c" (UID: "9aaf8a1f-48d4-4a84-b138-99724970fc5e") : secret "metrics-daemon-secret" not found Jun 12 18:24:14.296301 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:14.296266 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:24:26.982851 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:26.982801 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cfdjx" podUID="4692c660-7576-4e6d-b7c6-7c7b70200935" Jun 12 18:24:27.331721 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:27.331641 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:24:28.650299 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:28.650253 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-wnh5c" podUID="9aaf8a1f-48d4-4a84-b138-99724970fc5e" Jun 12 18:24:31.963980 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:31.963942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:24:31.964390 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:31.964064 2575 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jun 12 18:24:31.964390 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:31.964125 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls podName:4692c660-7576-4e6d-b7c6-7c7b70200935 nodeName:}" failed. No retries permitted until 2026-06-12 18:26:33.964110521 +0000 UTC m=+284.820477401 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls") pod "dns-default-cfdjx" (UID: "4692c660-7576-4e6d-b7c6-7c7b70200935") : secret "dns-default-metrics-tls" not found Jun 12 18:24:34.614406 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:34.614368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:24:43.630168 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:43.630067 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:24:45.383497 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.383405 2575 generic.go:356] "Generic (PLEG): container finished" podID="60faff35-33f0-4a4c-8654-5b8f6b95f4f0" containerID="5416b7e0a1c6381a5ff80c80abcd634b342847794566c319cb3f864122203011" exitCode=255 Jun 12 18:24:45.383497 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.383474 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerDied","Data":"5416b7e0a1c6381a5ff80c80abcd634b342847794566c319cb3f864122203011"} Jun 12 18:24:45.384983 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.384958 2575 generic.go:356] "Generic (PLEG): container finished" podID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" containerID="3b9727ba7db34010a944cbf93523714bfa6871a1c1c3874d49da27d35e3b1afa" exitCode=1 Jun 12 18:24:45.385109 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.384997 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerDied","Data":"3b9727ba7db34010a944cbf93523714bfa6871a1c1c3874d49da27d35e3b1afa"} Jun 12 18:24:45.385256 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.385242 2575 scope.go:117] "RemoveContainer" containerID="3b9727ba7db34010a944cbf93523714bfa6871a1c1c3874d49da27d35e3b1afa" Jun 12 18:24:45.389796 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:45.389782 2575 scope.go:117] "RemoveContainer" containerID="5416b7e0a1c6381a5ff80c80abcd634b342847794566c319cb3f864122203011" Jun 12 18:24:46.044296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:46.044247 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:24:46.389615 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:46.389532 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerStarted","Data":"93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d"} Jun 12 18:24:46.391137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:46.391113 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerStarted","Data":"1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43"} Jun 12 18:24:46.391308 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:46.391294 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:24:46.391908 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:46.391890 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:24:57.739922 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.739883 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:24:57.741671 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.741655 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.744683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.744659 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jun 12 18:24:57.744683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.744671 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jun 12 18:24:57.745053 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.745035 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-drmhm\"" Jun 12 18:24:57.747665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.747540 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jun 12 18:24:57.751064 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.751045 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jun 12 18:24:57.760926 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.760906 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:24:57.843308 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843280 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843476 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnmmc\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843476 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843352 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843476 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843374 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843476 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843426 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843510 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843533 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.843623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.843580 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.928301 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.928266 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw"] Jun 12 18:24:57.930074 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.930058 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:57.932562 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.932537 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jun 12 18:24:57.932878 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.932865 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jun 12 18:24:57.932949 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.932897 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jun 12 18:24:57.932949 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.932915 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-hmsf7\"" Jun 12 18:24:57.933024 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.932960 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:24:57.941277 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.941253 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw"] Jun 12 18:24:57.944574 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944552 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944592 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944611 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnmmc\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944636 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944663 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944692 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:57.944711 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:57.944725 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654dd5b554-h6v8s: secret "image-registry-tls" not found Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944730 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.944755 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.944884 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:57.944786 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls podName:e59f46e9-2605-44c2-a186-e6670be946ac nodeName:}" failed. No retries permitted until 2026-06-12 18:24:58.444766395 +0000 UTC m=+189.301133294 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls") pod "image-registry-654dd5b554-h6v8s" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac") : secret "image-registry-tls" not found Jun 12 18:24:57.945250 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.945221 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.945373 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.945304 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.945695 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.945674 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.947149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.947123 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.947222 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.947167 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.953710 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.953680 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnmmc\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.953710 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.953699 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:57.980676 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:57.980649 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:24:58.045846 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.045776 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8f30aa3-7444-4584-a06a-570e7153cd73-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.045846 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.045809 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2bjgb\" (UniqueName: \"kubernetes.io/projected/b8f30aa3-7444-4584-a06a-570e7153cd73-kube-api-access-2bjgb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.045988 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.045851 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f30aa3-7444-4584-a06a-570e7153cd73-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.081955 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.081923 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:24:58.147199 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.147167 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8f30aa3-7444-4584-a06a-570e7153cd73-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.147302 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.147207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2bjgb\" (UniqueName: \"kubernetes.io/projected/b8f30aa3-7444-4584-a06a-570e7153cd73-kube-api-access-2bjgb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.147302 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.147254 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f30aa3-7444-4584-a06a-570e7153cd73-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.147742 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.147724 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/b8f30aa3-7444-4584-a06a-570e7153cd73-config\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.149532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.149516 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/b8f30aa3-7444-4584-a06a-570e7153cd73-serving-cert\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.156850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.156819 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2bjgb\" (UniqueName: \"kubernetes.io/projected/b8f30aa3-7444-4584-a06a-570e7153cd73-kube-api-access-2bjgb\") pod \"kube-storage-version-migrator-operator-7c578b78fc-52lnw\" (UID: \"b8f30aa3-7444-4584-a06a-570e7153cd73\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.238962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.238929 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" Jun 12 18:24:58.357283 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.357258 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw"] Jun 12 18:24:58.359832 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:24:58.359798 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8f30aa3_7444_4584_a06a_570e7153cd73.slice/crio-e81f2b01c2d6711a808a091d83f92d954ef87abef32fc76042982bbfbdbf3caf WatchSource:0}: Error finding container e81f2b01c2d6711a808a091d83f92d954ef87abef32fc76042982bbfbdbf3caf: Status 404 returned error can't find the container with id e81f2b01c2d6711a808a091d83f92d954ef87abef32fc76042982bbfbdbf3caf Jun 12 18:24:58.423925 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.423894 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" event={"ID":"b8f30aa3-7444-4584-a06a-570e7153cd73","Type":"ContainerStarted","Data":"e81f2b01c2d6711a808a091d83f92d954ef87abef32fc76042982bbfbdbf3caf"} Jun 12 18:24:58.450242 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:58.450211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:58.450383 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:58.450370 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:24:58.450424 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:58.450387 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654dd5b554-h6v8s: secret "image-registry-tls" not found Jun 12 18:24:58.450466 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:58.450440 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls podName:e59f46e9-2605-44c2-a186-e6670be946ac nodeName:}" failed. No retries permitted until 2026-06-12 18:24:59.45042526 +0000 UTC m=+190.306792139 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls") pod "image-registry-654dd5b554-h6v8s" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac") : secret "image-registry-tls" not found Jun 12 18:24:59.457670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:59.457622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:24:59.458181 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:59.457791 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:24:59.458181 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:59.457805 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654dd5b554-h6v8s: secret "image-registry-tls" not found Jun 12 18:24:59.458181 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:24:59.457868 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls podName:e59f46e9-2605-44c2-a186-e6670be946ac nodeName:}" failed. No retries permitted until 2026-06-12 18:25:01.457848639 +0000 UTC m=+192.314215517 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls") pod "image-registry-654dd5b554-h6v8s" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac") : secret "image-registry-tls" not found Jun 12 18:24:59.962042 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:24:59.962002 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:00.014410 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:00.014370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:01.434269 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.434233 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" event={"ID":"b8f30aa3-7444-4584-a06a-570e7153cd73","Type":"ContainerStarted","Data":"7454ef9cdb11774c8b3f11d9ed737b928e85715348bc752688d851a2b4c876a7"} Jun 12 18:25:01.460674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.460623 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" podStartSLOduration=2.21426167 podStartE2EDuration="4.460608385s" totalImagesPullingTime="2.246346715s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:24:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:01.458563857 +0000 UTC m=+192.314930758" watchObservedRunningTime="2026-06-12 18:25:01.460608385 +0000 UTC m=+192.316975284" Jun 12 18:25:01.474297 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.473204 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:01.474297 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:01.473430 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:25:01.474297 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:01.473446 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654dd5b554-h6v8s: secret "image-registry-tls" not found Jun 12 18:25:01.474297 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:01.473499 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls podName:e59f46e9-2605-44c2-a186-e6670be946ac nodeName:}" failed. No retries permitted until 2026-06-12 18:25:05.473482034 +0000 UTC m=+196.329848932 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls") pod "image-registry-654dd5b554-h6v8s" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac") : secret "image-registry-tls" not found Jun 12 18:25:01.482745 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.482717 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:01.500470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.500444 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw"] Jun 12 18:25:01.502510 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.502484 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" Jun 12 18:25:01.505494 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.505473 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jun 12 18:25:01.505494 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.505499 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jun 12 18:25:01.505691 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.505473 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-zfw4z\"" Jun 12 18:25:01.514520 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.514493 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw"] Jun 12 18:25:01.574201 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.574160 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wk4fb\" (UniqueName: \"kubernetes.io/projected/ab7c4b0d-09af-44ea-ad9e-f258f76bc101-kube-api-access-wk4fb\") pod \"migrator-d4bcd4867-tqrsw\" (UID: \"ab7c4b0d-09af-44ea-ad9e-f258f76bc101\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" Jun 12 18:25:01.579608 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.579577 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:01.675180 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.675142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wk4fb\" (UniqueName: \"kubernetes.io/projected/ab7c4b0d-09af-44ea-ad9e-f258f76bc101-kube-api-access-wk4fb\") pod \"migrator-d4bcd4867-tqrsw\" (UID: \"ab7c4b0d-09af-44ea-ad9e-f258f76bc101\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" Jun 12 18:25:01.677640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.677617 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:01.682595 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.682576 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wk4fb\" (UniqueName: \"kubernetes.io/projected/ab7c4b0d-09af-44ea-ad9e-f258f76bc101-kube-api-access-wk4fb\") pod \"migrator-d4bcd4867-tqrsw\" (UID: \"ab7c4b0d-09af-44ea-ad9e-f258f76bc101\") " pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" Jun 12 18:25:01.811936 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.811853 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" Jun 12 18:25:01.940550 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:01.940517 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw"] Jun 12 18:25:01.943866 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:01.943839 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab7c4b0d_09af_44ea_ad9e_f258f76bc101.slice/crio-d14a9915601d2cba6e1e205338ae0bc321862c8ea12bbd49e49fe39000dc4d7e WatchSource:0}: Error finding container d14a9915601d2cba6e1e205338ae0bc321862c8ea12bbd49e49fe39000dc4d7e: Status 404 returned error can't find the container with id d14a9915601d2cba6e1e205338ae0bc321862c8ea12bbd49e49fe39000dc4d7e Jun 12 18:25:02.438999 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.438964 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" event={"ID":"ab7c4b0d-09af-44ea-ad9e-f258f76bc101","Type":"ContainerStarted","Data":"d14a9915601d2cba6e1e205338ae0bc321862c8ea12bbd49e49fe39000dc4d7e"} Jun 12 18:25:02.888193 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.888113 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-l8jd4"] Jun 12 18:25:02.890350 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.890308 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:02.892999 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.892972 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jun 12 18:25:02.894195 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.894150 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jun 12 18:25:02.894195 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.894179 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-xgl2j\"" Jun 12 18:25:02.894529 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.894162 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jun 12 18:25:02.894529 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.894162 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jun 12 18:25:02.906902 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.906878 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8jd4"] Jun 12 18:25:02.934001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.933956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:02.987080 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.987046 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/174af75e-5737-4e3c-8ae8-c8518e0f9aed-data-volume\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:02.987080 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.987085 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/174af75e-5737-4e3c-8ae8-c8518e0f9aed-crio-socket\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:02.987330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.987116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:02.987330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.987187 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:02.987330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:02.987216 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s7sv5\" (UniqueName: \"kubernetes.io/projected/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-api-access-s7sv5\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.034264 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.034222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:03.087984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.087956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/174af75e-5737-4e3c-8ae8-c8518e0f9aed-crio-socket\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088074 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088011 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088074 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088062 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088072 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/174af75e-5737-4e3c-8ae8-c8518e0f9aed-crio-socket\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s7sv5\" (UniqueName: \"kubernetes.io/projected/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-api-access-s7sv5\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088149 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.088117 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.088149 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.088138 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:03.088288 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.088178 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:03.588157967 +0000 UTC m=+194.444524872 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.088288 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.088202 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:03.588192376 +0000 UTC m=+194.444559295 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : configmap "kube-rbac-proxy" not found Jun 12 18:25:03.088288 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088251 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/174af75e-5737-4e3c-8ae8-c8518e0f9aed-data-volume\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.088634 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.088596 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/174af75e-5737-4e3c-8ae8-c8518e0f9aed-data-volume\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.098940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.098914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-s7sv5\" (UniqueName: \"kubernetes.io/projected/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-api-access-s7sv5\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.235331 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.235295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:03.336574 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.336537 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:03.443903 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.443868 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" event={"ID":"ab7c4b0d-09af-44ea-ad9e-f258f76bc101","Type":"ContainerStarted","Data":"91d285938b77939a4926a6bfb8ff6e4d44155901781bc40ae68cd927b2a321f0"} Jun 12 18:25:03.444261 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.443926 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" event={"ID":"ab7c4b0d-09af-44ea-ad9e-f258f76bc101","Type":"ContainerStarted","Data":"d99d28ce2f775838a47806f0c8b93ed2e3c631fac9169fe0d98edd3217d229e8"} Jun 12 18:25:03.460119 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.460073 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d4bcd4867-tqrsw" podStartSLOduration=1.328407543 podStartE2EDuration="2.460033307s" totalImagesPullingTime="1.131625764s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:03.459314863 +0000 UTC m=+194.315681762" watchObservedRunningTime="2026-06-12 18:25:03.460033307 +0000 UTC m=+194.316400205" Jun 12 18:25:03.592331 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.592290 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:03.593264 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.593245 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.593313 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.593285 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:03.593415 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.593399 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.593467 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.593460 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:04.593446285 +0000 UTC m=+195.449813161 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:03.593521 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.593399 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:03.593559 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:03.593540 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:04.593521654 +0000 UTC m=+195.449888531 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : configmap "kube-rbac-proxy" not found Jun 12 18:25:03.990986 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:03.990955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:04.091166 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:04.091135 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:04.600841 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:04.600786 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:04.601251 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:04.600861 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:04.601251 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:04.600959 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:04.601251 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:04.600992 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:04.601251 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:04.601015 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:06.600997614 +0000 UTC m=+197.457364494 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:04.601251 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:04.601060 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:06.601043222 +0000 UTC m=+197.457410111 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : configmap "kube-rbac-proxy" not found Jun 12 18:25:05.508595 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:05.508562 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:05.508759 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:05.508719 2575 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jun 12 18:25:05.508759 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:05.508739 2575 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-654dd5b554-h6v8s: secret "image-registry-tls" not found Jun 12 18:25:05.508866 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:05.508795 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls podName:e59f46e9-2605-44c2-a186-e6670be946ac nodeName:}" failed. No retries permitted until 2026-06-12 18:25:13.508776534 +0000 UTC m=+204.365143416 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls") pod "image-registry-654dd5b554-h6v8s" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac") : secret "image-registry-tls" not found Jun 12 18:25:05.574769 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:05.574733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:05.626615 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:05.626585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:05.887057 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:05.886985 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwz6z_6391b6d3-45a0-4091-a618-49bb943fec3b/dns-node-resolver/0.log" Jun 12 18:25:06.477437 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:06.477408 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:06.618290 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:06.618256 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:06.618477 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:06.618299 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:06.618477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:06.618386 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:06.618477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:06.618421 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:06.618477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:06.618441 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:10.618425872 +0000 UTC m=+201.474792749 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : configmap "kube-rbac-proxy" not found Jun 12 18:25:06.618477 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:06.618478 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:10.618464016 +0000 UTC m=+201.474830896 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:06.888264 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:06.888184 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npvkt_9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc/node-ca/0.log" Jun 12 18:25:07.291355 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.291301 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7gsd5_2e432100-d86d-471d-9e10-2539b77aba6f/serve-healthcheck-canary/0.log" Jun 12 18:25:07.315166 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.315129 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:07.413427 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.413396 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:07.516407 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.516368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:07.627541 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.627455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:07.698284 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.698251 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:07.890672 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:07.890598 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-tqrsw_ab7c4b0d-09af-44ea-ad9e-f258f76bc101/migrator/0.log" Jun 12 18:25:08.088263 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:08.088231 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-tqrsw_ab7c4b0d-09af-44ea-ad9e-f258f76bc101/graceful-termination/0.log" Jun 12 18:25:08.288658 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:08.288628 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-52lnw_b8f30aa3-7444-4584-a06a-570e7153cd73/kube-storage-version-migrator-operator/0.log" Jun 12 18:25:08.404808 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:08.404778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:08.800815 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:08.800783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:09.217840 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:09.217809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:09.409066 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:09.409037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:09.557885 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:09.557805 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:09.805795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:09.805762 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:10.604823 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:10.604791 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:10.651230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:10.651194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:10.651398 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:10.651252 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:10.651398 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:10.651358 2575 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jun 12 18:25:10.651398 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:10.651391 2575 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jun 12 18:25:10.651531 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:10.651426 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:18.651410151 +0000 UTC m=+209.507777028 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : secret "insights-runtime-extractor-tls" not found Jun 12 18:25:10.651531 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:10.651441 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm podName:174af75e-5737-4e3c-8ae8-c8518e0f9aed nodeName:}" failed. No retries permitted until 2026-06-12 18:25:18.651434564 +0000 UTC m=+209.507801441 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm") pod "insights-runtime-extractor-l8jd4" (UID: "174af75e-5737-4e3c-8ae8-c8518e0f9aed") : configmap "kube-rbac-proxy" not found Jun 12 18:25:11.008305 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:11.008268 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:11.164325 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:11.164294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:11.265428 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:11.265322 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:11.410044 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:11.410005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:11.602298 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:11.602216 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:12.605255 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:12.605224 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:12.802976 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:12.802944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:12.875515 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:12.875435 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:13.208677 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.208646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:13.403804 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.403767 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:13.581183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.581089 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:13.583585 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.583551 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"image-registry-654dd5b554-h6v8s\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:13.605671 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.605625 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:13.650567 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.650542 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:13.775642 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.775508 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:25:13.778107 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:13.778074 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode59f46e9_2605_44c2_a186_e6670be946ac.slice/crio-bb30364baee58d8965c95188d62108df5c8e577a530ae40c8a586f3e8edd3f2b WatchSource:0}: Error finding container bb30364baee58d8965c95188d62108df5c8e577a530ae40c8a586f3e8edd3f2b: Status 404 returned error can't find the container with id bb30364baee58d8965c95188d62108df5c8e577a530ae40c8a586f3e8edd3f2b Jun 12 18:25:13.813846 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:13.813822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:14.480374 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.480326 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" event={"ID":"e59f46e9-2605-44c2-a186-e6670be946ac","Type":"ContainerStarted","Data":"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6"} Jun 12 18:25:14.480570 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.480392 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" event={"ID":"e59f46e9-2605-44c2-a186-e6670be946ac","Type":"ContainerStarted","Data":"bb30364baee58d8965c95188d62108df5c8e577a530ae40c8a586f3e8edd3f2b"} Jun 12 18:25:14.480570 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.480473 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:14.501000 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.500947 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" podStartSLOduration=17.500932647 podStartE2EDuration="17.500932647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:24:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:14.499423053 +0000 UTC m=+205.355789952" watchObservedRunningTime="2026-06-12 18:25:14.500932647 +0000 UTC m=+205.357299546" Jun 12 18:25:14.571700 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.571667 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:14.671391 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.671355 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:14.802449 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:14.802360 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:15.205908 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:15.205875 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:15.399312 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:15.399277 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:15.805785 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:15.805754 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:16.401211 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:16.401175 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:16.808788 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:16.808755 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:17.210144 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:17.210113 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:17.604450 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:17.604363 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:17.806562 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:17.806530 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:18.000601 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.000571 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:18.718551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.718504 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:18.718551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.718556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:18.719063 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.719044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/174af75e-5737-4e3c-8ae8-c8518e0f9aed-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:18.720845 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.720823 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/174af75e-5737-4e3c-8ae8-c8518e0f9aed-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-l8jd4\" (UID: \"174af75e-5737-4e3c-8ae8-c8518e0f9aed\") " pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:18.802902 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.802863 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-l8jd4" Jun 12 18:25:18.928154 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:18.928118 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-l8jd4"] Jun 12 18:25:18.930845 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:18.930819 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod174af75e_5737_4e3c_8ae8_c8518e0f9aed.slice/crio-5fac8ca8c99711d3700c61f2df12ecfb7c910cc18fa9e406af2093f9c9ce5c61 WatchSource:0}: Error finding container 5fac8ca8c99711d3700c61f2df12ecfb7c910cc18fa9e406af2093f9c9ce5c61: Status 404 returned error can't find the container with id 5fac8ca8c99711d3700c61f2df12ecfb7c910cc18fa9e406af2093f9c9ce5c61 Jun 12 18:25:19.497784 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:19.497589 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8jd4" event={"ID":"174af75e-5737-4e3c-8ae8-c8518e0f9aed","Type":"ContainerStarted","Data":"5fac8ca8c99711d3700c61f2df12ecfb7c910cc18fa9e406af2093f9c9ce5c61"} Jun 12 18:25:22.509802 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:22.509715 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8jd4" event={"ID":"174af75e-5737-4e3c-8ae8-c8518e0f9aed","Type":"ContainerStarted","Data":"d7553eff6463899ca6dfbfa887f8d70ea67bcb6149bef1a35f0301df9bb95cd1"} Jun 12 18:25:23.514485 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:23.514442 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8jd4" event={"ID":"174af75e-5737-4e3c-8ae8-c8518e0f9aed","Type":"ContainerStarted","Data":"6043a488f43a5d9ca2c57d5887644df2772da809afb506e5250c5e324a1cf9cf"} Jun 12 18:25:23.847956 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:23.847870 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:23.945130 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:23.945096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.012773 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.012738 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.162561 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.162519 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.322717 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.322679 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.515710 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.515629 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.611487 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.611447 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.714514 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.714478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:24.815254 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:24.815215 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:25.522708 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:25.522669 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-l8jd4" event={"ID":"174af75e-5737-4e3c-8ae8-c8518e0f9aed","Type":"ContainerStarted","Data":"884379e3514f689aaf7b092d2b3f69069acaea3a9144edea2977add08fa0bb69"} Jun 12 18:25:25.540631 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:25.540586 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-l8jd4" podStartSLOduration=17.775157555 podStartE2EDuration="23.540572693s" totalImagesPullingTime="5.765415138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:25:02 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:25.539149496 +0000 UTC m=+216.395516395" watchObservedRunningTime="2026-06-12 18:25:25.540572693 +0000 UTC m=+216.396939592" Jun 12 18:25:25.726211 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:25.726180 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:25.997783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:25.997751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:26.007500 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.007471 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:25:26.140074 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.140037 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:26.237376 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.237328 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:26.342019 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.341943 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:26.437528 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.437492 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:26.747986 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:26.747956 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:27.822525 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:27.822438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:28.885409 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:28.885372 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:32.123555 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:32.123520 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:32.224122 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:32.224082 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:32.738420 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:32.738391 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:32.834836 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:32.834812 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:32.899851 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:32.899822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:33.049886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:33.049801 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:35.908372 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:35.908318 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:35.978847 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:35.978811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:36.012818 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:36.012788 2575 patch_prober.go:28] interesting pod/image-registry-654dd5b554-h6v8s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:36.012963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:36.012836 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:25:36.384096 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:36.384012 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:37.147724 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:37.147688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:37.207483 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:37.207453 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:38.344194 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:38.344144 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:38.393391 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:38.393329 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:39.359711 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:39.359677 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:41.753846 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:41.753814 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:41.853382 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:41.853321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.044600 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.044506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.259434 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.259398 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.266004 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.265975 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf"] Jun 12 18:25:42.268988 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.268973 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.271792 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.271770 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-jcrf5\"" Jun 12 18:25:42.272019 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.271995 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jun 12 18:25:42.272997 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.272979 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jun 12 18:25:42.273276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.273234 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jun 12 18:25:42.273387 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.273325 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jun 12 18:25:42.273772 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.273743 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jun 12 18:25:42.282012 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.281992 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf"] Jun 12 18:25:42.291360 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.291324 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293c94c-67dd-4694-b985-d8617e70eb5f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.291462 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.291369 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw6sr\" (UniqueName: \"kubernetes.io/projected/0293c94c-67dd-4694-b985-d8617e70eb5f-kube-api-access-pw6sr\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.291462 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.291395 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.291551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.291472 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.300078 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.300030 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jgv4w"] Jun 12 18:25:42.303301 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.303278 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.305686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.305656 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jun 12 18:25:42.305790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.305693 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jun 12 18:25:42.305862 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.305837 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9jkqd\"" Jun 12 18:25:42.306146 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.306128 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jun 12 18:25:42.392178 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392142 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw6sr\" (UniqueName: \"kubernetes.io/projected/0293c94c-67dd-4694-b985-d8617e70eb5f-kube-api-access-pw6sr\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.392178 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392181 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392211 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392237 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-metrics-client-ca\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392267 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392295 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-wtmp\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392380 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-root\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:42.392399 2575 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392430 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392470 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:42.392464 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls podName:0293c94c-67dd-4694-b985-d8617e70eb5f nodeName:}" failed. No retries permitted until 2026-06-12 18:25:42.892439078 +0000 UTC m=+233.748805958 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls") pod "openshift-state-metrics-6b8d965dd5-b2cnf" (UID: "0293c94c-67dd-4694-b985-d8617e70eb5f") : secret "openshift-state-metrics-tls" not found Jun 12 18:25:42.392765 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392528 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ls485\" (UniqueName: \"kubernetes.io/projected/0204feba-07a8-4e35-ac92-e74cd39e74a3-kube-api-access-ls485\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392765 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392555 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392765 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392597 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-textfile\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.392765 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392651 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293c94c-67dd-4694-b985-d8617e70eb5f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.392765 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.392677 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-sys\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.393205 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.393186 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0293c94c-67dd-4694-b985-d8617e70eb5f-metrics-client-ca\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.394591 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.394574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.405574 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.405552 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw6sr\" (UniqueName: \"kubernetes.io/projected/0293c94c-67dd-4694-b985-d8617e70eb5f-kube-api-access-pw6sr\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.412754 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.412728 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.483438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.483404 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.493658 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493626 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.493752 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-metrics-client-ca\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.493837 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493820 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-wtmp\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.493868 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493852 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-root\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.493902 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493891 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.493980 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493956 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-root\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494036 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.493992 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-wtmp\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494036 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:42.493997 2575 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jun 12 18:25:42.494036 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494024 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ls485\" (UniqueName: \"kubernetes.io/projected/0204feba-07a8-4e35-ac92-e74cd39e74a3-kube-api-access-ls485\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494173 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:42.494073 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls podName:0204feba-07a8-4e35-ac92-e74cd39e74a3 nodeName:}" failed. No retries permitted until 2026-06-12 18:25:42.994053659 +0000 UTC m=+233.850420539 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls") pod "node-exporter-jgv4w" (UID: "0204feba-07a8-4e35-ac92-e74cd39e74a3") : secret "node-exporter-tls" not found Jun 12 18:25:42.494173 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494088 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494173 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494117 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-textfile\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494320 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494172 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-sys\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494320 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494214 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-metrics-client-ca\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494320 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494242 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0204feba-07a8-4e35-ac92-e74cd39e74a3-sys\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494320 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.494519 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.494461 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-textfile\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.496304 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.496285 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.502085 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.502065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ls485\" (UniqueName: \"kubernetes.io/projected/0204feba-07a8-4e35-ac92-e74cd39e74a3-kube-api-access-ls485\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.651462 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.651379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.749481 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.749448 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.849231 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.849197 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.896209 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.896184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.898730 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.898704 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/0293c94c-67dd-4694-b985-d8617e70eb5f-openshift-state-metrics-tls\") pod \"openshift-state-metrics-6b8d965dd5-b2cnf\" (UID: \"0293c94c-67dd-4694-b985-d8617e70eb5f\") " pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:42.964767 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.964733 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:42.996690 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.996659 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:42.998906 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:42.998887 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0204feba-07a8-4e35-ac92-e74cd39e74a3-node-exporter-tls\") pod \"node-exporter-jgv4w\" (UID: \"0204feba-07a8-4e35-ac92-e74cd39e74a3\") " pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:43.061980 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.061928 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:43.179953 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.179917 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" Jun 12 18:25:43.212484 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.212454 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgv4w" Jun 12 18:25:43.223462 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:43.223424 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0204feba_07a8_4e35_ac92_e74cd39e74a3.slice/crio-5911df8c53b1fc78c44f8632c30f6aee6b0a4915edc3fc283ef34a1477b79fea WatchSource:0}: Error finding container 5911df8c53b1fc78c44f8632c30f6aee6b0a4915edc3fc283ef34a1477b79fea: Status 404 returned error can't find the container with id 5911df8c53b1fc78c44f8632c30f6aee6b0a4915edc3fc283ef34a1477b79fea Jun 12 18:25:43.260419 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.260382 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:43.311320 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.311287 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf"] Jun 12 18:25:43.314629 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:43.314601 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0293c94c_67dd_4694_b985_d8617e70eb5f.slice/crio-1b272df9027421b42c972683f06190c41d059672f794a92bd44053997f13b893 WatchSource:0}: Error finding container 1b272df9027421b42c972683f06190c41d059672f794a92bd44053997f13b893: Status 404 returned error can't find the container with id 1b272df9027421b42c972683f06190c41d059672f794a92bd44053997f13b893 Jun 12 18:25:43.341138 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.341116 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:43.344711 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.344690 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:25:43.348572 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.348554 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.351183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351162 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jun 12 18:25:43.351183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351174 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jun 12 18:25:43.351377 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351191 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-9pxv6\"" Jun 12 18:25:43.351377 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351207 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jun 12 18:25:43.351377 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351193 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jun 12 18:25:43.351377 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351363 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jun 12 18:25:43.351522 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351435 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jun 12 18:25:43.351670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351652 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jun 12 18:25:43.351754 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351678 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jun 12 18:25:43.351754 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.351700 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jun 12 18:25:43.364537 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.364516 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:25:43.399838 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399811 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.399943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399840 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.399943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399861 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.399943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399880 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.399943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399965 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v6274\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.399987 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400000 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400020 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400079 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400062 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400255 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400096 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400255 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400116 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.400255 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.400153 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.457968 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.457941 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:43.501244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501166 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501207 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501227 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501246 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v6274\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501292 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501322 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501367 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501402 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501430 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.501535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501465 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.502023 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501556 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.502023 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501583 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.502023 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.501831 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.502360 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.502298 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.502453 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:43.502359 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle podName:e67dd168-744b-43fb-b03b-8afdebf4889b nodeName:}" failed. No retries permitted until 2026-06-12 18:25:44.002319197 +0000 UTC m=+234.858686086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "alertmanager-trusted-ca-bundle" (UniqueName: "kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle") pod "alertmanager-main-0" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b") : configmap references non-existent config key: ca-bundle.crt Jun 12 18:25:43.504839 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.504839 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504462 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.504839 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504789 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.504839 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504800 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.505123 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504880 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.505123 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.504890 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.505225 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.505152 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.505928 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.505910 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.506414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.506398 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.512182 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.512161 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v6274\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:43.579698 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.579663 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" event={"ID":"0293c94c-67dd-4694-b985-d8617e70eb5f","Type":"ContainerStarted","Data":"dc689b0781a830f9b4632a83ff70b915f0e67845e3b4cc748575bf7842b6f6de"} Jun 12 18:25:43.579865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.579725 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" event={"ID":"0293c94c-67dd-4694-b985-d8617e70eb5f","Type":"ContainerStarted","Data":"99b46b85a2ccaefdbe09d8fae4e43a2702da3b54b22003f1bd98744a7436e9dd"} Jun 12 18:25:43.579865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.579754 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" event={"ID":"0293c94c-67dd-4694-b985-d8617e70eb5f","Type":"ContainerStarted","Data":"1b272df9027421b42c972683f06190c41d059672f794a92bd44053997f13b893"} Jun 12 18:25:43.580738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:43.580714 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgv4w" event={"ID":"0204feba-07a8-4e35-ac92-e74cd39e74a3","Type":"ContainerStarted","Data":"5911df8c53b1fc78c44f8632c30f6aee6b0a4915edc3fc283ef34a1477b79fea"} Jun 12 18:25:44.005177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.005135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:44.006138 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.006112 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:44.260867 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.260797 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:25:44.588503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.588458 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" event={"ID":"0293c94c-67dd-4694-b985-d8617e70eb5f","Type":"ContainerStarted","Data":"427fc35645e2d2db5c7bc7d4f3ece3f1fb6bf3cce5b4b9716f4884b17a5f301e"} Jun 12 18:25:44.590473 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.590429 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgv4w" event={"ID":"0204feba-07a8-4e35-ac92-e74cd39e74a3","Type":"ContainerStarted","Data":"0ecef670ff4b727fae80a2acfc528134ea171611e51c462675287a1bac06172d"} Jun 12 18:25:44.611408 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.611221 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-6b8d965dd5-b2cnf" podStartSLOduration=1.5566235449999999 podStartE2EDuration="2.611207709s" totalImagesPullingTime="1.054584164s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:44.609532748 +0000 UTC m=+235.465899659" watchObservedRunningTime="2026-06-12 18:25:44.611207709 +0000 UTC m=+235.467574608" Jun 12 18:25:44.642845 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:44.642819 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:25:44.645086 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:44.645052 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode67dd168_744b_43fb_b03b_8afdebf4889b.slice/crio-8e3c3e29ff71c82f1b5857aa9f84636f0e76dcac34674388968aece36dffd526 WatchSource:0}: Error finding container 8e3c3e29ff71c82f1b5857aa9f84636f0e76dcac34674388968aece36dffd526: Status 404 returned error can't find the container with id 8e3c3e29ff71c82f1b5857aa9f84636f0e76dcac34674388968aece36dffd526 Jun 12 18:25:45.109623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.109591 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:45.175541 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.175510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:45.263663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.263629 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:45.267837 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.267815 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-575d84b964-9rhsq"] Jun 12 18:25:45.271477 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.271456 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.274186 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274139 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jun 12 18:25:45.274186 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274171 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-25bt6ihb9j057\"" Jun 12 18:25:45.274445 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274415 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jun 12 18:25:45.274549 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274484 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jun 12 18:25:45.274549 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274491 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jun 12 18:25:45.274549 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274518 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jun 12 18:25:45.274827 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.274808 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-br96s\"" Jun 12 18:25:45.282939 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.282893 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-575d84b964-9rhsq"] Jun 12 18:25:45.317293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317265 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-metrics-client-ca\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317475 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317318 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317475 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317450 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317486 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317505 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkz9n\" (UniqueName: \"kubernetes.io/projected/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-kube-api-access-kkz9n\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317699 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317585 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317699 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317668 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-grpc-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.317791 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.317766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418652 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418605 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-grpc-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418826 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418752 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418826 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418784 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-metrics-client-ca\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418894 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418826 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418894 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418990 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418899 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418990 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418923 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkz9n\" (UniqueName: \"kubernetes.io/projected/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-kube-api-access-kkz9n\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.418990 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.418954 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.419702 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.419638 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-metrics-client-ca\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421373 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421325 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421327 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421570 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-grpc-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421793 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421777 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421841 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421805 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.421874 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.421813 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-secret-thanos-querier-tls\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.426756 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.426736 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkz9n\" (UniqueName: \"kubernetes.io/projected/3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc-kube-api-access-kkz9n\") pod \"thanos-querier-575d84b964-9rhsq\" (UID: \"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc\") " pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.449625 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.449598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:45.583349 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.583295 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:45.595515 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.595487 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"8e3c3e29ff71c82f1b5857aa9f84636f0e76dcac34674388968aece36dffd526"} Jun 12 18:25:45.597313 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.597279 2575 generic.go:356] "Generic (PLEG): container finished" podID="0204feba-07a8-4e35-ac92-e74cd39e74a3" containerID="0ecef670ff4b727fae80a2acfc528134ea171611e51c462675287a1bac06172d" exitCode=0 Jun 12 18:25:45.597464 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.597378 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgv4w" event={"ID":"0204feba-07a8-4e35-ac92-e74cd39e74a3","Type":"ContainerDied","Data":"0ecef670ff4b727fae80a2acfc528134ea171611e51c462675287a1bac06172d"} Jun 12 18:25:45.622670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.622646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:45.743531 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:45.743497 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-575d84b964-9rhsq"] Jun 12 18:25:45.933158 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:45.933128 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a0b9fe4_de89_4c8e_9732_9c665b6ffcfc.slice/crio-b8782580354c770964de26265dea9d6cc60d22b1362dfa4467186d142870919c WatchSource:0}: Error finding container b8782580354c770964de26265dea9d6cc60d22b1362dfa4467186d142870919c: Status 404 returned error can't find the container with id b8782580354c770964de26265dea9d6cc60d22b1362dfa4467186d142870919c Jun 12 18:25:46.012930 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.012889 2575 patch_prober.go:28] interesting pod/image-registry-654dd5b554-h6v8s container/registry namespace/openshift-image-registry: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jun 12 18:25:46.013047 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.012954 2575 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jun 12 18:25:46.602170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.602121 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"b8782580354c770964de26265dea9d6cc60d22b1362dfa4467186d142870919c"} Jun 12 18:25:46.603888 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.603856 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6" exitCode=0 Jun 12 18:25:46.604024 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.603946 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6"} Jun 12 18:25:46.606866 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.606801 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgv4w" event={"ID":"0204feba-07a8-4e35-ac92-e74cd39e74a3","Type":"ContainerStarted","Data":"36e8ba00780dd18b284b13d6a9f7535d17feb9c3cee9e6e75cdad10f9ce44f44"} Jun 12 18:25:46.606866 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.606843 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgv4w" event={"ID":"0204feba-07a8-4e35-ac92-e74cd39e74a3","Type":"ContainerStarted","Data":"a8b4502a1bae62e55f33414f5c9ecd9935f3874ffd91a3b0778c81438e40a19a"} Jun 12 18:25:46.647259 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.647205 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jgv4w" podStartSLOduration=3.297726129 podStartE2EDuration="4.647188523s" totalImagesPullingTime="1.276255081s" totalInitContainerRuntime="73.207313ms" isStatefulPod=true podCreationTimestamp="2026-06-12 18:25:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:46.646519459 +0000 UTC m=+237.502886384" watchObservedRunningTime="2026-06-12 18:25:46.647188523 +0000 UTC m=+237.503555429" Jun 12 18:25:46.684691 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.684646 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-546c9d8685-rlkwn"] Jun 12 18:25:46.687800 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.687774 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.690605 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690573 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jun 12 18:25:46.690738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690670 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jun 12 18:25:46.690738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690700 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-nbklp\"" Jun 12 18:25:46.690738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690718 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-49ncum08ki8g6\"" Jun 12 18:25:46.690898 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690803 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jun 12 18:25:46.690969 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.690951 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jun 12 18:25:46.696816 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.696794 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-546c9d8685-rlkwn"] Jun 12 18:25:46.731193 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731157 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf2b029b-5b1e-41b8-aa76-314ff271df57-audit-log\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731193 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731191 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731227 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-tls\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731289 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-client-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731329 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h8l5\" (UniqueName: \"kubernetes.io/projected/bf2b029b-5b1e-41b8-aa76-314ff271df57-kube-api-access-7h8l5\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731385 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-metrics-server-audit-profiles\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.731454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.731447 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-client-certs\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.832883 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.832841 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf2b029b-5b1e-41b8-aa76-314ff271df57-audit-log\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.832883 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.832885 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833139 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833069 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-tls\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833139 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-client-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833139 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833135 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h8l5\" (UniqueName: \"kubernetes.io/projected/bf2b029b-5b1e-41b8-aa76-314ff271df57-kube-api-access-7h8l5\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833299 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833169 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-metrics-server-audit-profiles\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833299 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833194 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-client-certs\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833299 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833237 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/bf2b029b-5b1e-41b8-aa76-314ff271df57-audit-log\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.833723 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.833694 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.834086 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.834065 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/bf2b029b-5b1e-41b8-aa76-314ff271df57-metrics-server-audit-profiles\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.835702 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.835677 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-client-ca-bundle\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.835820 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.835720 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-tls\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.835820 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.835749 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/bf2b029b-5b1e-41b8-aa76-314ff271df57-secret-metrics-server-client-certs\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.841275 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.841252 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h8l5\" (UniqueName: \"kubernetes.io/projected/bf2b029b-5b1e-41b8-aa76-314ff271df57-kube-api-access-7h8l5\") pod \"metrics-server-546c9d8685-rlkwn\" (UID: \"bf2b029b-5b1e-41b8-aa76-314ff271df57\") " pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:46.999290 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:46.999251 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:25:47.078852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:47.078820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:47.142033 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:47.142007 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-546c9d8685-rlkwn"] Jun 12 18:25:47.144527 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:47.144500 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:47.145020 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:47.144984 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf2b029b_5b1e_41b8_aa76_314ff271df57.slice/crio-a83eba978ee01e51861738a8644e34edd80b3d4027d98a0202025050864856ac WatchSource:0}: Error finding container a83eba978ee01e51861738a8644e34edd80b3d4027d98a0202025050864856ac: Status 404 returned error can't find the container with id a83eba978ee01e51861738a8644e34edd80b3d4027d98a0202025050864856ac Jun 12 18:25:47.544988 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:47.544950 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:47.612619 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:47.612542 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" event={"ID":"bf2b029b-5b1e-41b8-aa76-314ff271df57","Type":"ContainerStarted","Data":"a83eba978ee01e51861738a8644e34edd80b3d4027d98a0202025050864856ac"} Jun 12 18:25:48.385222 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.385157 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:48.488990 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.488944 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:48.503163 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.503134 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:25:48.507026 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.507001 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.509771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509708 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 18:25:48.509771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509720 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 18:25:48.509771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509720 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 18:25:48.510001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509783 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6fh6t\"" Jun 12 18:25:48.510001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509795 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 18:25:48.510001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.509712 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 18:25:48.510760 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.510740 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8gql5q2sgta4c\"" Jun 12 18:25:48.510871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.510838 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 18:25:48.510871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.510848 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 18:25:48.510997 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.510945 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 18:25:48.510997 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.510963 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 18:25:48.511089 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.511076 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 18:25:48.511183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.511152 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 18:25:48.511183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.511173 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 18:25:48.511492 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.511474 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 18:25:48.513366 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.513325 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 18:25:48.521526 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.521504 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:25:48.549971 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.549926 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pk5c\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550097 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550052 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550097 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550088 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550109 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550148 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550172 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550197 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550566 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550263 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550731 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550694 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550760 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550851 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550919 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550894 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.550974 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.550942 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551050 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551632 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551697 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551730 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551766 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.555414 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.551806 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.557987 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.557965 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652722 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652772 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652810 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652836 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652863 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652888 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652912 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652941 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.652975 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653025 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pk5c\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653071 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653092 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653112 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653156 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653179 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653201 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.653228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653236 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653269 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653297 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653323 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.653867 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.654124 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.654532 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.654267 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.655209 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.655069 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.656771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.656732 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.657136 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.657093 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.657486 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.657444 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.657819 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.657780 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.658361 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.658140 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.658361 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.658302 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.658504 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.658384 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.658644 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.658598 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.658764 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.658743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659063 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659038 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659166 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659087 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659220 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659253 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659620 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.659696 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.659682 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.662995 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.662974 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pk5c\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c\") pod \"prometheus-k8s-0\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:48.818675 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:48.818637 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:49.231732 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.231326 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:25:49.233163 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:25:49.233092 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfaddd42c_9b64_460f_bd5b_aea1b3f9f7a8.slice/crio-fc82f318464ed1a727a137596b307b7f6b584bc6b3ee695ab41ad51a9f8cd050 WatchSource:0}: Error finding container fc82f318464ed1a727a137596b307b7f6b584bc6b3ee695ab41ad51a9f8cd050: Status 404 returned error can't find the container with id fc82f318464ed1a727a137596b307b7f6b584bc6b3ee695ab41ad51a9f8cd050 Jun 12 18:25:49.622278 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.622196 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d"} Jun 12 18:25:49.622278 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.622266 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7"} Jun 12 18:25:49.622501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.622304 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885"} Jun 12 18:25:49.622501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.622348 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a"} Jun 12 18:25:49.622501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.622377 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc"} Jun 12 18:25:49.623567 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.623540 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" event={"ID":"bf2b029b-5b1e-41b8-aa76-314ff271df57","Type":"ContainerStarted","Data":"e6e58f460cbcca5f85bbb1265d2571ffc7864fc079bf2802b6b341936eaed490"} Jun 12 18:25:49.624972 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.624948 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="8e3efe1b5f245304cb288ec9dd52558c95203a14d1e6659879ea507f51fb004a" exitCode=0 Jun 12 18:25:49.625073 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.625029 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"8e3efe1b5f245304cb288ec9dd52558c95203a14d1e6659879ea507f51fb004a"} Jun 12 18:25:49.625131 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.625081 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"fc82f318464ed1a727a137596b307b7f6b584bc6b3ee695ab41ad51a9f8cd050"} Jun 12 18:25:49.627228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.627209 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"9c71bd670423341a3e597f53d5284a8035280f470f93b6a577fc162278801066"} Jun 12 18:25:49.627318 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.627273 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"b134e5fe28eb87b422c814187ff026b8757e472342918e935808c0dcc3dfc47b"} Jun 12 18:25:49.627397 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.627332 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"b9fb5d2c03e7b6b2710efa329663716b6025e589417e788b55da7bac7220571c"} Jun 12 18:25:49.671685 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:49.671017 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" podStartSLOduration=1.743401336 podStartE2EDuration="3.670997918s" totalImagesPullingTime="1.927596582s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:49.640152912 +0000 UTC m=+240.496519813" watchObservedRunningTime="2026-06-12 18:25:49.670997918 +0000 UTC m=+240.527364814" Jun 12 18:25:50.430107 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.430076 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:50.481724 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.481695 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:50.637230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.637150 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"4c89c5c85a40b3e22cce72d59b2d3b13b064bb430ad94eeb88625477518abc38"} Jun 12 18:25:50.637393 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.637264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"162f7572986dec6d78163f56ab31aa27bdd32de4efa37cc751b02e7c2b346b48"} Jun 12 18:25:50.637393 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.637315 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:50.637393 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.637391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" event={"ID":"3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc","Type":"ContainerStarted","Data":"da3dd6e8127d6aa9c7ef814a50b1a8cf76a5f92e61e2429e2c279fb31a169aa9"} Jun 12 18:25:50.641529 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.641370 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerStarted","Data":"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41"} Jun 12 18:25:50.684608 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.684541 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" podStartSLOduration=1.456097664 podStartE2EDuration="5.684520627s" totalImagesPullingTime="4.228422963s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:45 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:50.659498371 +0000 UTC m=+241.515865272" watchObservedRunningTime="2026-06-12 18:25:50.684520627 +0000 UTC m=+241.540887530" Jun 12 18:25:50.685523 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:50.685479 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.959505689 podStartE2EDuration="7.685468627s" totalImagesPullingTime="4.70672676s" totalInitContainerRuntime="19.236178ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:43 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:50.683971905 +0000 UTC m=+241.540338814" watchObservedRunningTime="2026-06-12 18:25:50.685468627 +0000 UTC m=+241.541835525" Jun 12 18:25:51.026962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.026905 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" containerID="cri-o://ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6" gracePeriod=30 Jun 12 18:25:51.284767 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.284708 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:51.378782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378750 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.378962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378798 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.378962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378832 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.378962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378878 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.378962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378908 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.378962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.378940 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xnmmc\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.379206 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.379023 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.379206 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.379057 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates\") pod \"e59f46e9-2605-44c2-a186-e6670be946ac\" (UID: \"e59f46e9-2605-44c2-a186-e6670be946ac\") " Jun 12 18:25:51.379293 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.379238 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:25:51.379441 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.379405 2575 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-trusted-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.379691 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.379668 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:25:51.381744 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.381701 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:25:51.382013 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.381920 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:25:51.382013 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.381984 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc" (OuterVolumeSpecName: "kube-api-access-xnmmc") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "kube-api-access-xnmmc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:25:51.382150 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.382123 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:25:51.382359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.382317 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:25:51.390422 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.390399 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "e59f46e9-2605-44c2-a186-e6670be946ac" (UID: "e59f46e9-2605-44c2-a186-e6670be946ac"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:25:51.480110 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480079 2575 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-bound-sa-token\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480110 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480104 2575 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e59f46e9-2605-44c2-a186-e6670be946ac-registry-certificates\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480110 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480114 2575 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-registry-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480353 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480123 2575 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e59f46e9-2605-44c2-a186-e6670be946ac-ca-trust-extracted\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480353 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480135 2575 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-image-registry-private-configuration\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480353 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480150 2575 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e59f46e9-2605-44c2-a186-e6670be946ac-installation-pull-secrets\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.480353 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.480158 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xnmmc\" (UniqueName: \"kubernetes.io/projected/e59f46e9-2605-44c2-a186-e6670be946ac-kube-api-access-xnmmc\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:25:51.648573 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.648481 2575 generic.go:356] "Generic (PLEG): container finished" podID="e59f46e9-2605-44c2-a186-e6670be946ac" containerID="ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6" exitCode=0 Jun 12 18:25:51.648573 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.648547 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" Jun 12 18:25:51.648795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.648606 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" event={"ID":"e59f46e9-2605-44c2-a186-e6670be946ac","Type":"ContainerDied","Data":"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6"} Jun 12 18:25:51.648795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.648649 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-654dd5b554-h6v8s" event={"ID":"e59f46e9-2605-44c2-a186-e6670be946ac","Type":"ContainerDied","Data":"bb30364baee58d8965c95188d62108df5c8e577a530ae40c8a586f3e8edd3f2b"} Jun 12 18:25:51.648795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.648675 2575 scope.go:117] "RemoveContainer" containerID="ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6" Jun 12 18:25:51.659383 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.659364 2575 scope.go:117] "RemoveContainer" containerID="ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6" Jun 12 18:25:51.659720 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:25:51.659700 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6\": container with ID starting with ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6 not found: ID does not exist" containerID="ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6" Jun 12 18:25:51.659789 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.659728 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6"} err="failed to get container status \"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6\": rpc error: code = NotFound desc = could not find container \"ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6\": container with ID starting with ac5092eb667bbea68f06120c3cb166ed7dd35f03eba76f2a7baeeabb3d0acdd6 not found: ID does not exist" Jun 12 18:25:51.667108 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.667078 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:25:51.669903 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:51.669883 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-654dd5b554-h6v8s"] Jun 12 18:25:53.227409 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.227383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:53.328311 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.328284 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:53.636123 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.636098 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" path="/var/lib/kubelet/pods/e59f46e9-2605-44c2-a186-e6670be946ac/volumes" Jun 12 18:25:53.665640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.664848 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"d968b2473e88ebc4c8c0b4d7f2734111f043b2bd662a415a46e327680d6eb9e5"} Jun 12 18:25:53.665640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.664930 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"eb1de15d60cc1b41af5727f2e48656363dde4718f93bfdf30c205d839fe26279"} Jun 12 18:25:53.665640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.664969 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"5df2e8d4780267c53e3ea663a3f8d3b28f1b1ae8fc824390f0d5997c455f2faa"} Jun 12 18:25:53.665640 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:53.665005 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"0a8cdd83b818eb2c6736bec7f36ac785e4f4e07bf49ef0a2ce467e75771e55f9"} Jun 12 18:25:54.259679 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:54.259646 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:54.671628 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:54.671595 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"477dddc02aad94ebfee12c77c3cc225b4613a31e89d8e5a754eeb72c00f02bf9"} Jun 12 18:25:54.671799 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:54.671655 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerStarted","Data":"c0c71bafcdbd94ba84464b22f51af600aec989339acaa0b470334cdfb114c626"} Jun 12 18:25:54.706055 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:54.705999 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.104274517 podStartE2EDuration="6.705984499s" totalImagesPullingTime="3.572515853s" totalInitContainerRuntime="29.194129ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:25:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:25:54.705175897 +0000 UTC m=+245.561542819" watchObservedRunningTime="2026-06-12 18:25:54.705984499 +0000 UTC m=+245.562351399" Jun 12 18:25:54.934127 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:54.934040 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:55.034140 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:55.034106 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:25:56.654829 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:56.654805 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-575d84b964-9rhsq" Jun 12 18:25:58.819673 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:58.819641 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:25:59.980632 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:25:59.980599 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:00.032510 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.032478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:00.464228 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.464198 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:26:00.466576 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.466544 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/9aaf8a1f-48d4-4a84-b138-99724970fc5e-metrics-certs\") pod \"network-metrics-daemon-wnh5c\" (UID: \"9aaf8a1f-48d4-4a84-b138-99724970fc5e\") " pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:26:00.734054 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.733967 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-kk7mw\"" Jun 12 18:26:00.742105 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.742084 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-wnh5c" Jun 12 18:26:00.873525 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:00.873498 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-wnh5c"] Jun 12 18:26:00.875859 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:26:00.875829 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9aaf8a1f_48d4_4a84_b138_99724970fc5e.slice/crio-2532e49d365e014c2d62a7fbcc86f131c771de27085ccbd48fc5313e165f4513 WatchSource:0}: Error finding container 2532e49d365e014c2d62a7fbcc86f131c771de27085ccbd48fc5313e165f4513: Status 404 returned error can't find the container with id 2532e49d365e014c2d62a7fbcc86f131c771de27085ccbd48fc5313e165f4513 Jun 12 18:26:01.700933 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:01.700895 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnh5c" event={"ID":"9aaf8a1f-48d4-4a84-b138-99724970fc5e","Type":"ContainerStarted","Data":"2532e49d365e014c2d62a7fbcc86f131c771de27085ccbd48fc5313e165f4513"} Jun 12 18:26:02.706787 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.706748 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnh5c" event={"ID":"9aaf8a1f-48d4-4a84-b138-99724970fc5e","Type":"ContainerStarted","Data":"8c90c61a97580b41257377fdfe8cc1922c51b2630c0f40ef76de577150fd61b0"} Jun 12 18:26:02.707296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.706802 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-wnh5c" event={"ID":"9aaf8a1f-48d4-4a84-b138-99724970fc5e","Type":"ContainerStarted","Data":"570431029d8b72205fc0239ce314806c8726ba528463367da7d668b7e201a9c6"} Jun 12 18:26:02.724167 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.724115 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-wnh5c" podStartSLOduration=252.620126047 podStartE2EDuration="4m13.724099164s" totalImagesPullingTime="1.103973117s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:21:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:26:02.722394306 +0000 UTC m=+253.578761206" watchObservedRunningTime="2026-06-12 18:26:02.724099164 +0000 UTC m=+253.580466074" Jun 12 18:26:02.807493 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.807459 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:02.861567 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.861532 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:02.914955 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:02.914907 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:05.890021 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:05.889982 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:05.943932 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:05.943891 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:05.995721 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:05.995685 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:07.000084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:07.000047 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:26:07.000473 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:07.000100 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:26:09.598081 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:09.597993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:09.647600 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:09.647570 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:11.306621 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:11.306576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:11.362032 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:11.361983 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:19.291621 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:19.291585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:19.392714 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:19.392671 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:21.782290 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:21.782255 2575 generic.go:356] "Generic (PLEG): container finished" podID="b8f30aa3-7444-4584-a06a-570e7153cd73" containerID="7454ef9cdb11774c8b3f11d9ed737b928e85715348bc752688d851a2b4c876a7" exitCode=0 Jun 12 18:26:21.782702 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:21.782308 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" event={"ID":"b8f30aa3-7444-4584-a06a-570e7153cd73","Type":"ContainerDied","Data":"7454ef9cdb11774c8b3f11d9ed737b928e85715348bc752688d851a2b4c876a7"} Jun 12 18:26:21.782702 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:21.782648 2575 scope.go:117] "RemoveContainer" containerID="7454ef9cdb11774c8b3f11d9ed737b928e85715348bc752688d851a2b4c876a7" Jun 12 18:26:22.787733 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:22.787699 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-7c578b78fc-52lnw" event={"ID":"b8f30aa3-7444-4584-a06a-570e7153cd73","Type":"ContainerStarted","Data":"4ce539fbc5a9d5df6ff7cd0d503c82109f833df466f1c2fe8a4aaf854fac3fea"} Jun 12 18:26:24.830448 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:24.830420 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/init-config-reloader/0.log" Jun 12 18:26:25.029358 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.029322 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/alertmanager/0.log" Jun 12 18:26:25.229918 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.229873 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/config-reloader/0.log" Jun 12 18:26:25.314535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.314502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:25.431614 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.431589 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/kube-rbac-proxy-web/0.log" Jun 12 18:26:25.631859 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.631782 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/kube-rbac-proxy/0.log" Jun 12 18:26:25.831549 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:25.831522 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/kube-rbac-proxy-metric/0.log" Jun 12 18:26:26.032425 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:26.032396 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_e67dd168-744b-43fb-b03b-8afdebf4889b/prom-label-proxy/0.log" Jun 12 18:26:27.005607 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:27.005570 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:26:27.009394 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:27.009371 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-546c9d8685-rlkwn" Jun 12 18:26:27.029524 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:27.029495 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-546c9d8685-rlkwn_bf2b029b-5b1e-41b8-aa76-314ff271df57/metrics-server/0.log" Jun 12 18:26:28.029745 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:28.029717 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/init-textfile/0.log" Jun 12 18:26:28.230527 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:28.230499 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/node-exporter/0.log" Jun 12 18:26:28.429207 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:28.429178 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/kube-rbac-proxy/0.log" Jun 12 18:26:28.736842 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:28.736766 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:28.837586 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:28.837549 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:29.228960 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:29.228933 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/kube-rbac-proxy-main/0.log" Jun 12 18:26:29.429019 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:29.428991 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/kube-rbac-proxy-self/0.log" Jun 12 18:26:29.630167 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:29.630085 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/openshift-state-metrics/0.log" Jun 12 18:26:29.829636 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:29.829613 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/init-config-reloader/0.log" Jun 12 18:26:30.030814 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.030790 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/prometheus/0.log" Jun 12 18:26:30.229230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.229200 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/config-reloader/0.log" Jun 12 18:26:30.332811 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:30.332726 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-cfdjx" podUID="4692c660-7576-4e6d-b7c6-7c7b70200935" Jun 12 18:26:30.429827 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.429800 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/thanos-sidecar/0.log" Jun 12 18:26:30.629402 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.629312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/kube-rbac-proxy-web/0.log" Jun 12 18:26:30.818199 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.818169 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:30.829819 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:30.829796 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/kube-rbac-proxy/0.log" Jun 12 18:26:31.029828 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:31.029795 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/kube-rbac-proxy-thanos/0.log" Jun 12 18:26:32.430271 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:32.430244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/thanos-query/0.log" Jun 12 18:26:32.629596 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:32.629563 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-web/0.log" Jun 12 18:26:32.829963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:32.829890 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy/0.log" Jun 12 18:26:33.029797 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:33.029768 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/prom-label-proxy/0.log" Jun 12 18:26:33.230021 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:33.229995 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-rules/0.log" Jun 12 18:26:33.429709 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:33.429677 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-metrics/0.log" Jun 12 18:26:34.062849 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.062817 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:34.065147 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.065127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4692c660-7576-4e6d-b7c6-7c7b70200935-metrics-tls\") pod \"dns-default-cfdjx\" (UID: \"4692c660-7576-4e6d-b7c6-7c7b70200935\") " pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:34.121891 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.121861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7f5r6\"" Jun 12 18:26:34.130110 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.130083 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:34.260431 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.260404 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-cfdjx"] Jun 12 18:26:34.262975 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:26:34.262947 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4692c660_7576_4e6d_b7c6_7c7b70200935.slice/crio-e0b72c7924cd64649f43e6ec1b0664dceb0239e4d5f01d9ea1f5b613bc705fd4 WatchSource:0}: Error finding container e0b72c7924cd64649f43e6ec1b0664dceb0239e4d5f01d9ea1f5b613bc705fd4: Status 404 returned error can't find the container with id e0b72c7924cd64649f43e6ec1b0664dceb0239e4d5f01d9ea1f5b613bc705fd4 Jun 12 18:26:34.838771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:34.838732 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfdjx" event={"ID":"4692c660-7576-4e6d-b7c6-7c7b70200935","Type":"ContainerStarted","Data":"e0b72c7924cd64649f43e6ec1b0664dceb0239e4d5f01d9ea1f5b613bc705fd4"} Jun 12 18:26:36.829643 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:36.829615 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwz6z_6391b6d3-45a0-4091-a618-49bb943fec3b/dns-node-resolver/0.log" Jun 12 18:26:36.849446 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:36.849415 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfdjx" event={"ID":"4692c660-7576-4e6d-b7c6-7c7b70200935","Type":"ContainerStarted","Data":"4a8327328cf8ea057560bd31e23837a2d76506389d17bd657640ca5f25753a5b"} Jun 12 18:26:36.849618 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:36.849466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-cfdjx" event={"ID":"4692c660-7576-4e6d-b7c6-7c7b70200935","Type":"ContainerStarted","Data":"80fd47e20097949a23e30df212f56b53ed2607186a7190a1d02ea1f9da1366f6"} Jun 12 18:26:36.849618 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:36.849534 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:36.869244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:36.869194 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-cfdjx" podStartSLOduration=252.131958882 podStartE2EDuration="4m13.869177898s" totalImagesPullingTime="1.737219016s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:22:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:26:36.868126789 +0000 UTC m=+287.724493691" watchObservedRunningTime="2026-06-12 18:26:36.869177898 +0000 UTC m=+287.725544817" Jun 12 18:26:37.829872 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:37.829838 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npvkt_9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc/node-ca/0.log" Jun 12 18:26:38.229388 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:38.229358 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7gsd5_2e432100-d86d-471d-9e10-2539b77aba6f/serve-healthcheck-canary/0.log" Jun 12 18:26:38.294355 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:38.294298 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:38.345745 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:38.345709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.447206 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.447164 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.496812 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.496778 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.549099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.549062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.650269 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.650231 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.811583 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.811495 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:44.871500 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:44.871469 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:45.895173 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.895083 2575 generic.go:356] "Generic (PLEG): container finished" podID="60faff35-33f0-4a4c-8654-5b8f6b95f4f0" containerID="93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d" exitCode=255 Jun 12 18:26:45.895173 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.895162 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerDied","Data":"93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d"} Jun 12 18:26:45.895668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.895206 2575 scope.go:117] "RemoveContainer" containerID="5416b7e0a1c6381a5ff80c80abcd634b342847794566c319cb3f864122203011" Jun 12 18:26:45.897233 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.897207 2575 generic.go:356] "Generic (PLEG): container finished" podID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" containerID="1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43" exitCode=1 Jun 12 18:26:45.897348 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.897280 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerDied","Data":"1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43"} Jun 12 18:26:45.897656 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.897641 2575 scope.go:117] "RemoveContainer" containerID="1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43" Jun 12 18:26:45.897873 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:45.897853 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fffb79cf9-qhssw_open-cluster-management-agent-addon(46f7f9ef-5b64-443b-8e40-8efe88cc93ad)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" podUID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" Jun 12 18:26:45.902105 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.902083 2575 scope.go:117] "RemoveContainer" containerID="93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d" Jun 12 18:26:45.902275 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:45.902257 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-57fbd77c58-snsk8_open-cluster-management-agent-addon(60faff35-33f0-4a4c-8654-5b8f6b95f4f0)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" podUID="60faff35-33f0-4a4c-8654-5b8f6b95f4f0" Jun 12 18:26:45.906227 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:45.906212 2575 scope.go:117] "RemoveContainer" containerID="3b9727ba7db34010a944cbf93523714bfa6871a1c1c3874d49da27d35e3b1afa" Jun 12 18:26:46.391586 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:46.391552 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:26:46.855438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:46.855410 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-cfdjx" Jun 12 18:26:46.904763 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:46.904736 2575 scope.go:117] "RemoveContainer" containerID="1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43" Jun 12 18:26:46.905496 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:46.905468 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fffb79cf9-qhssw_open-cluster-management-agent-addon(46f7f9ef-5b64-443b-8e40-8efe88cc93ad)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" podUID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" Jun 12 18:26:47.558221 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:47.558183 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:47.610037 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:47.610004 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:48.412036 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:48.412003 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:48.472086 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:48.472051 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:48.819738 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:48.819661 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:26:48.840943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:48.840913 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:26:48.931085 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:48.931059 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:26:49.572582 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.572551 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:26:49.578048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.578022 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:26:49.581375 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.581358 2575 kubelet.go:1648] "Image garbage collection succeeded" Jun 12 18:26:49.716956 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.716912 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" Jun 12 18:26:49.723017 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.722995 2575 scope.go:117] "RemoveContainer" containerID="93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d" Jun 12 18:26:49.723233 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:49.723211 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"addon-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=addon-agent pod=managed-serviceaccount-addon-agent-57fbd77c58-snsk8_open-cluster-management-agent-addon(60faff35-33f0-4a4c-8654-5b8f6b95f4f0)\"" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" podUID="60faff35-33f0-4a4c-8654-5b8f6b95f4f0" Jun 12 18:26:49.750938 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.750908 2575 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:26:49.751330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:49.751314 2575 scope.go:117] "RemoveContainer" containerID="1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43" Jun 12 18:26:49.751550 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:26:49.751527 2575 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"acm-agent\" with CrashLoopBackOff: \"back-off 10s restarting failed container=acm-agent pod=klusterlet-addon-workmgr-7fffb79cf9-qhssw_open-cluster-management-agent-addon(46f7f9ef-5b64-443b-8e40-8efe88cc93ad)\"" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" podUID="46f7f9ef-5b64-443b-8e40-8efe88cc93ad" Jun 12 18:26:52.389063 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:52.389027 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:52.490535 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:52.490506 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:52.548636 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:52.548593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:54.014625 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:54.014598 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:54.066177 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:54.066146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:54.198645 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:54.198613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:54.300448 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:54.300370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:57.427552 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:57.427523 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:57.481469 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:57.481438 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:58.310100 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:58.310069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:58.413200 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:58.413174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:59.247077 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:59.247047 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:26:59.347478 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:26:59.347450 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:01.630131 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:01.630100 2575 scope.go:117] "RemoveContainer" containerID="93a8e4422c34d94b9cf8714f69899abae88f20bf5b00f768e95270f7ad1ea05d" Jun 12 18:27:01.971028 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:01.970992 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-57fbd77c58-snsk8" event={"ID":"60faff35-33f0-4a4c-8654-5b8f6b95f4f0","Type":"ContainerStarted","Data":"4cb9af81e99e32ce0f026332b4477729f163ba39b1af2ae31bec4fd9da37ddd8"} Jun 12 18:27:02.573955 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.573913 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:02.574530 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.574475 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="alertmanager" containerID="cri-o://13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" gracePeriod=120 Jun 12 18:27:02.574784 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.574734 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy" containerID="cri-o://1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" gracePeriod=120 Jun 12 18:27:02.574993 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.574918 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="prom-label-proxy" containerID="cri-o://6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" gracePeriod=120 Jun 12 18:27:02.574993 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.574921 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-web" containerID="cri-o://4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" gracePeriod=120 Jun 12 18:27:02.575099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.574991 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="config-reloader" containerID="cri-o://ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" gracePeriod=120 Jun 12 18:27:02.575099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.575036 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-metric" containerID="cri-o://efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" gracePeriod=120 Jun 12 18:27:02.979328 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979297 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" exitCode=0 Jun 12 18:27:02.979328 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979323 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" exitCode=0 Jun 12 18:27:02.979328 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979330 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" exitCode=0 Jun 12 18:27:02.979758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979354 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" exitCode=0 Jun 12 18:27:02.979758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979360 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41"} Jun 12 18:27:02.979758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979425 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7"} Jun 12 18:27:02.979758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a"} Jun 12 18:27:02.979758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:02.979477 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc"} Jun 12 18:27:03.821037 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.821009 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:03.925277 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925248 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925293 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925312 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925371 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925390 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925415 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925438 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v6274\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925778 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925477 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925778 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925674 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:27:03.925778 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925742 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925778 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925774 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925823 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925909 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.925984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.925945 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume\") pod \"e67dd168-744b-43fb-b03b-8afdebf4889b\" (UID: \"e67dd168-744b-43fb-b03b-8afdebf4889b\") " Jun 12 18:27:03.926135 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.926051 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:03.926135 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.926085 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:03.926237 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.926227 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-main-db\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:03.926292 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.926246 2575 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-metrics-client-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:03.926292 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.926264 2575 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e67dd168-744b-43fb-b03b-8afdebf4889b-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:03.928926 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.928886 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274" (OuterVolumeSpecName: "kube-api-access-v6274") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "kube-api-access-v6274". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:27:03.929250 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.929213 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.929557 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.929517 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume" (OuterVolumeSpecName: "config-volume") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.929642 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.929543 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.929820 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.929789 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.930170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.930146 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out" (OuterVolumeSpecName: "config-out") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:27:03.930387 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.930358 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.931493 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.931469 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:27:03.934289 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.934270 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.940282 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.940257 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config" (OuterVolumeSpecName: "web-config") pod "e67dd168-744b-43fb-b03b-8afdebf4889b" (UID: "e67dd168-744b-43fb-b03b-8afdebf4889b"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:03.986906 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.986877 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" exitCode=0 Jun 12 18:27:03.986906 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.986902 2575 generic.go:356] "Generic (PLEG): container finished" podID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerID="4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" exitCode=0 Jun 12 18:27:03.987296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.986948 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d"} Jun 12 18:27:03.987296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.986970 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jun 12 18:27:03.987296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.987035 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885"} Jun 12 18:27:03.987296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.987078 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"e67dd168-744b-43fb-b03b-8afdebf4889b","Type":"ContainerDied","Data":"8e3c3e29ff71c82f1b5857aa9f84636f0e76dcac34674388968aece36dffd526"} Jun 12 18:27:03.987296 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.987099 2575 scope.go:117] "RemoveContainer" containerID="6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" Jun 12 18:27:03.995399 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:03.995376 2575 scope.go:117] "RemoveContainer" containerID="efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" Jun 12 18:27:04.002345 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.002315 2575 scope.go:117] "RemoveContainer" containerID="1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" Jun 12 18:27:04.009695 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.009663 2575 scope.go:117] "RemoveContainer" containerID="4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" Jun 12 18:27:04.011304 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.011287 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:04.014869 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.014848 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jun 12 18:27:04.017218 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.017200 2575 scope.go:117] "RemoveContainer" containerID="ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" Jun 12 18:27:04.024015 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.023994 2575 scope.go:117] "RemoveContainer" containerID="13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" Jun 12 18:27:04.027475 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027452 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e67dd168-744b-43fb-b03b-8afdebf4889b-config-out\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027556 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027480 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-tls-assets\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027556 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027496 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027556 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027514 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v6274\" (UniqueName: \"kubernetes.io/projected/e67dd168-744b-43fb-b03b-8afdebf4889b-kube-api-access-v6274\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027555 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-web-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027572 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027586 2575 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-cluster-tls-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027600 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-main-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027614 2575 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.027663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.027627 2575 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/e67dd168-744b-43fb-b03b-8afdebf4889b-config-volume\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:04.030909 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.030893 2575 scope.go:117] "RemoveContainer" containerID="b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6" Jun 12 18:27:04.039677 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.039662 2575 scope.go:117] "RemoveContainer" containerID="6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" Jun 12 18:27:04.039971 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.039953 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41\": container with ID starting with 6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41 not found: ID does not exist" containerID="6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" Jun 12 18:27:04.040025 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.039978 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41"} err="failed to get container status \"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41\": rpc error: code = NotFound desc = could not find container \"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41\": container with ID starting with 6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41 not found: ID does not exist" Jun 12 18:27:04.040025 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.039997 2575 scope.go:117] "RemoveContainer" containerID="efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" Jun 12 18:27:04.040214 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.040199 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d\": container with ID starting with efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d not found: ID does not exist" containerID="efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" Jun 12 18:27:04.040257 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040218 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d"} err="failed to get container status \"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d\": rpc error: code = NotFound desc = could not find container \"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d\": container with ID starting with efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d not found: ID does not exist" Jun 12 18:27:04.040257 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040237 2575 scope.go:117] "RemoveContainer" containerID="1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" Jun 12 18:27:04.040487 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.040467 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7\": container with ID starting with 1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7 not found: ID does not exist" containerID="1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" Jun 12 18:27:04.040558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040498 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7"} err="failed to get container status \"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7\": rpc error: code = NotFound desc = could not find container \"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7\": container with ID starting with 1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7 not found: ID does not exist" Jun 12 18:27:04.040558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040521 2575 scope.go:117] "RemoveContainer" containerID="4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" Jun 12 18:27:04.040753 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.040735 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885\": container with ID starting with 4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885 not found: ID does not exist" containerID="4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" Jun 12 18:27:04.040790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040758 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885"} err="failed to get container status \"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885\": rpc error: code = NotFound desc = could not find container \"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885\": container with ID starting with 4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885 not found: ID does not exist" Jun 12 18:27:04.040790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.040772 2575 scope.go:117] "RemoveContainer" containerID="ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" Jun 12 18:27:04.041008 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.040992 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a\": container with ID starting with ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a not found: ID does not exist" containerID="ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" Jun 12 18:27:04.041060 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041011 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a"} err="failed to get container status \"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a\": rpc error: code = NotFound desc = could not find container \"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a\": container with ID starting with ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a not found: ID does not exist" Jun 12 18:27:04.041060 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041024 2575 scope.go:117] "RemoveContainer" containerID="13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" Jun 12 18:27:04.041228 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.041211 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc\": container with ID starting with 13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc not found: ID does not exist" containerID="13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" Jun 12 18:27:04.041289 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041235 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc"} err="failed to get container status \"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc\": rpc error: code = NotFound desc = could not find container \"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc\": container with ID starting with 13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc not found: ID does not exist" Jun 12 18:27:04.041289 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041256 2575 scope.go:117] "RemoveContainer" containerID="b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6" Jun 12 18:27:04.041494 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:27:04.041474 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6\": container with ID starting with b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6 not found: ID does not exist" containerID="b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6" Jun 12 18:27:04.041554 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041531 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6"} err="failed to get container status \"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6\": rpc error: code = NotFound desc = could not find container \"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6\": container with ID starting with b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6 not found: ID does not exist" Jun 12 18:27:04.041591 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041557 2575 scope.go:117] "RemoveContainer" containerID="6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41" Jun 12 18:27:04.041799 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041783 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41"} err="failed to get container status \"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41\": rpc error: code = NotFound desc = could not find container \"6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41\": container with ID starting with 6ebbc8f49cc45214600f872ee072a8462ccff4fc24fb1cbf7361decf944e3d41 not found: ID does not exist" Jun 12 18:27:04.041799 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041798 2575 scope.go:117] "RemoveContainer" containerID="efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d" Jun 12 18:27:04.042002 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.041988 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d"} err="failed to get container status \"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d\": rpc error: code = NotFound desc = could not find container \"efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d\": container with ID starting with efd136ae9bc3ef4b149bb61066c8eca053363f98907146c7c07e9ae6cf599f2d not found: ID does not exist" Jun 12 18:27:04.042002 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042000 2575 scope.go:117] "RemoveContainer" containerID="1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7" Jun 12 18:27:04.042217 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042199 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7"} err="failed to get container status \"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7\": rpc error: code = NotFound desc = could not find container \"1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7\": container with ID starting with 1adc3d0e2f9dee7efdeaf92344f7a5e18918057fa2732c812d08066eba5226f7 not found: ID does not exist" Jun 12 18:27:04.042263 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042219 2575 scope.go:117] "RemoveContainer" containerID="4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885" Jun 12 18:27:04.042454 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042437 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885"} err="failed to get container status \"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885\": rpc error: code = NotFound desc = could not find container \"4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885\": container with ID starting with 4d8acb9980c0264636f19704b5e8fb6a8b12398b510935548ef117cd7be8b885 not found: ID does not exist" Jun 12 18:27:04.042503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042454 2575 scope.go:117] "RemoveContainer" containerID="ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a" Jun 12 18:27:04.042667 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042651 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a"} err="failed to get container status \"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a\": rpc error: code = NotFound desc = could not find container \"ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a\": container with ID starting with ab31da8b20a40d14f3dccadf56af472ab83176953af0333460fe4122b89a324a not found: ID does not exist" Jun 12 18:27:04.042715 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042667 2575 scope.go:117] "RemoveContainer" containerID="13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc" Jun 12 18:27:04.042921 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042888 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc"} err="failed to get container status \"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc\": rpc error: code = NotFound desc = could not find container \"13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc\": container with ID starting with 13eb6a0f68a7550e1287e2cdb06c0b1e372b3052de5928c6c39adb6fbe6cf7fc not found: ID does not exist" Jun 12 18:27:04.042960 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.042923 2575 scope.go:117] "RemoveContainer" containerID="b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6" Jun 12 18:27:04.043155 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.043139 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6"} err="failed to get container status \"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6\": rpc error: code = NotFound desc = could not find container \"b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6\": container with ID starting with b87b90996500b3936fbc43be3a99646801643bf0681333b5f647b485da481cc6 not found: ID does not exist" Jun 12 18:27:04.630404 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.630372 2575 scope.go:117] "RemoveContainer" containerID="1b304c2d84b568514fbf78bda25c41aff93736fc59b03d3ce9875c723966ce43" Jun 12 18:27:04.992827 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.992789 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" event={"ID":"46f7f9ef-5b64-443b-8e40-8efe88cc93ad","Type":"ContainerStarted","Data":"152a10048634d45fc23e15b8ae5ee1851a36014ee8d8412b3b6f430b465407be"} Jun 12 18:27:04.993283 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.993077 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:27:04.994626 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:04.994599 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-7fffb79cf9-qhssw" Jun 12 18:27:05.635330 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:05.635296 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" path="/var/lib/kubelet/pods/e67dd168-744b-43fb-b03b-8afdebf4889b/volumes" Jun 12 18:27:06.811126 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811090 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:06.811558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811396 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="prometheus" containerID="cri-o://0a8cdd83b818eb2c6736bec7f36ac785e4f4e07bf49ef0a2ce467e75771e55f9" gracePeriod=600 Jun 12 18:27:06.811558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811410 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy" containerID="cri-o://c0c71bafcdbd94ba84464b22f51af600aec989339acaa0b470334cdfb114c626" gracePeriod=600 Jun 12 18:27:06.811558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811434 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="thanos-sidecar" containerID="cri-o://eb1de15d60cc1b41af5727f2e48656363dde4718f93bfdf30c205d839fe26279" gracePeriod=600 Jun 12 18:27:06.811558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811478 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-thanos" containerID="cri-o://477dddc02aad94ebfee12c77c3cc225b4613a31e89d8e5a754eeb72c00f02bf9" gracePeriod=600 Jun 12 18:27:06.811558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811519 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-web" containerID="cri-o://d968b2473e88ebc4c8c0b4d7f2734111f043b2bd662a415a46e327680d6eb9e5" gracePeriod=600 Jun 12 18:27:06.811794 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:06.811487 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="config-reloader" containerID="cri-o://5df2e8d4780267c53e3ea663a3f8d3b28f1b1ae8fc824390f0d5997c455f2faa" gracePeriod=600 Jun 12 18:27:07.006438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006398 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="477dddc02aad94ebfee12c77c3cc225b4613a31e89d8e5a754eeb72c00f02bf9" exitCode=0 Jun 12 18:27:07.006438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006432 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="c0c71bafcdbd94ba84464b22f51af600aec989339acaa0b470334cdfb114c626" exitCode=0 Jun 12 18:27:07.006438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006442 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="d968b2473e88ebc4c8c0b4d7f2734111f043b2bd662a415a46e327680d6eb9e5" exitCode=0 Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006451 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="eb1de15d60cc1b41af5727f2e48656363dde4718f93bfdf30c205d839fe26279" exitCode=0 Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006461 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="5df2e8d4780267c53e3ea663a3f8d3b28f1b1ae8fc824390f0d5997c455f2faa" exitCode=0 Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006470 2575 generic.go:356] "Generic (PLEG): container finished" podID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerID="0a8cdd83b818eb2c6736bec7f36ac785e4f4e07bf49ef0a2ce467e75771e55f9" exitCode=0 Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006466 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"477dddc02aad94ebfee12c77c3cc225b4613a31e89d8e5a754eeb72c00f02bf9"} Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006565 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"c0c71bafcdbd94ba84464b22f51af600aec989339acaa0b470334cdfb114c626"} Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006613 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"d968b2473e88ebc4c8c0b4d7f2734111f043b2bd662a415a46e327680d6eb9e5"} Jun 12 18:27:07.006668 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006654 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"eb1de15d60cc1b41af5727f2e48656363dde4718f93bfdf30c205d839fe26279"} Jun 12 18:27:07.006943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006692 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"5df2e8d4780267c53e3ea663a3f8d3b28f1b1ae8fc824390f0d5997c455f2faa"} Jun 12 18:27:07.006943 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.006731 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"0a8cdd83b818eb2c6736bec7f36ac785e4f4e07bf49ef0a2ce467e75771e55f9"} Jun 12 18:27:07.047002 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.046972 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:07.154102 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154068 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154125 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154161 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154181 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154213 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154238 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154276 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154263 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154286 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154322 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154383 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154413 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pk5c\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154446 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154494 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154523 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154548 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154605 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154635 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.154665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154661 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.155151 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154686 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.155151 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154712 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle\") pod \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\" (UID: \"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8\") " Jun 12 18:27:07.155151 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154895 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.155151 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.154999 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-metrics-client-ca\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.155371 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.155229 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.155610 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.155555 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.155694 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.155642 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.155694 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.155666 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.156372 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.156320 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.156743 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.156715 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:27:07.156884 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.156833 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:27:07.157856 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.157819 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out" (OuterVolumeSpecName: "config-out") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:27:07.158357 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158310 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.158593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158467 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.158593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158520 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.158593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158562 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.158593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158581 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.158852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158617 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c" (OuterVolumeSpecName: "kube-api-access-9pk5c") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "kube-api-access-9pk5c". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:27:07.158999 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.158977 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config" (OuterVolumeSpecName: "config") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.159256 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.159239 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:27:07.159846 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.159827 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.159972 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.159958 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.168240 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.168220 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config" (OuterVolumeSpecName: "web-config") pod "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" (UID: "faddd42c-9b64-460f-bd5b-aea1b3f9f7a8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jun 12 18:27:07.255878 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255849 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.255878 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255872 2575 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-web-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.255878 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255883 2575 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-grpc-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255892 2575 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-kube-rbac-proxy\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255900 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255909 2575 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-tls-assets\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255919 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255928 2575 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255936 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pk5c\" (UniqueName: \"kubernetes.io/projected/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-kube-api-access-9pk5c\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255946 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255956 2575 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255964 2575 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-secret-metrics-client-certs\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255972 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255980 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-db\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.255991 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.256006 2575 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.256019 2575 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-config-out\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.256033 2575 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:07.256084 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:07.256047 2575 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:27:08.014005 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.013973 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"faddd42c-9b64-460f-bd5b-aea1b3f9f7a8","Type":"ContainerDied","Data":"fc82f318464ed1a727a137596b307b7f6b584bc6b3ee695ab41ad51a9f8cd050"} Jun 12 18:27:08.014389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.014046 2575 scope.go:117] "RemoveContainer" containerID="477dddc02aad94ebfee12c77c3cc225b4613a31e89d8e5a754eeb72c00f02bf9" Jun 12 18:27:08.014389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.014045 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.021674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.021655 2575 scope.go:117] "RemoveContainer" containerID="c0c71bafcdbd94ba84464b22f51af600aec989339acaa0b470334cdfb114c626" Jun 12 18:27:08.028963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.028945 2575 scope.go:117] "RemoveContainer" containerID="d968b2473e88ebc4c8c0b4d7f2734111f043b2bd662a415a46e327680d6eb9e5" Jun 12 18:27:08.035415 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.035356 2575 scope.go:117] "RemoveContainer" containerID="eb1de15d60cc1b41af5727f2e48656363dde4718f93bfdf30c205d839fe26279" Jun 12 18:27:08.037516 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.037495 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:08.041297 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.041274 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:08.042707 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.042693 2575 scope.go:117] "RemoveContainer" containerID="5df2e8d4780267c53e3ea663a3f8d3b28f1b1ae8fc824390f0d5997c455f2faa" Jun 12 18:27:08.049201 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.049181 2575 scope.go:117] "RemoveContainer" containerID="0a8cdd83b818eb2c6736bec7f36ac785e4f4e07bf49ef0a2ce467e75771e55f9" Jun 12 18:27:08.056428 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.056412 2575 scope.go:117] "RemoveContainer" containerID="8e3efe1b5f245304cb288ec9dd52558c95203a14d1e6659879ea507f51fb004a" Jun 12 18:27:08.068501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068475 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:08.068789 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068775 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068793 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068803 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="config-reloader" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068809 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="config-reloader" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068816 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068821 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068829 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="alertmanager" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068835 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="alertmanager" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068842 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068848 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068856 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068861 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" Jun 12 18:27:08.068865 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068866 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="prom-label-proxy" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068872 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="prom-label-proxy" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068881 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-thanos" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068886 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-thanos" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068892 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-metric" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068898 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-metric" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068905 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="thanos-sidecar" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068911 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="thanos-sidecar" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068918 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="prometheus" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068925 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="prometheus" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068932 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068940 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068951 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="init-config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068958 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="init-config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068965 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068973 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068983 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="init-config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.068988 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="init-config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069038 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069047 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-metric" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069052 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="prom-label-proxy" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069060 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e59f46e9-2605-44c2-a186-e6670be946ac" containerName="registry" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069066 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069072 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069078 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="config-reloader" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069087 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="thanos-sidecar" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069094 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="alertmanager" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069099 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="prometheus" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069104 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" containerName="kube-rbac-proxy-thanos" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069108 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy-web" Jun 12 18:27:08.069202 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.069113 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="e67dd168-744b-43fb-b03b-8afdebf4889b" containerName="kube-rbac-proxy" Jun 12 18:27:08.074082 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.074064 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.076905 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.076882 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jun 12 18:27:08.077007 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.076922 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-8gql5q2sgta4c\"" Jun 12 18:27:08.077007 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.076942 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jun 12 18:27:08.077233 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077216 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jun 12 18:27:08.077354 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077297 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jun 12 18:27:08.077354 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077300 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jun 12 18:27:08.077491 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077389 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jun 12 18:27:08.077491 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077418 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jun 12 18:27:08.077655 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077629 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jun 12 18:27:08.077758 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077729 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jun 12 18:27:08.077822 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077772 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jun 12 18:27:08.077889 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077861 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jun 12 18:27:08.077998 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.077896 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-6fh6t\"" Jun 12 18:27:08.078057 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.078040 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jun 12 18:27:08.081603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.081328 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jun 12 18:27:08.085563 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.085533 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jun 12 18:27:08.090394 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.090365 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:08.160665 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160622 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160664 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160704 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qxnx6\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-kube-api-access-qxnx6\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160725 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160743 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160758 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160781 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.160852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160826 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160875 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160905 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160921 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160938 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.160979 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161016 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161033 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161066 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161084 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161101 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161117 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.161153 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.161144 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261648 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261614 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261648 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261650 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261674 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261705 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261734 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261756 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qxnx6\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-kube-api-access-qxnx6\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261785 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261812 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261835 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261860 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.261881 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261879 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261910 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261942 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261965 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.261987 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262016 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262050 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262083 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262126 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262154 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262329 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.262980 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.262818 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.263429 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.263386 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.264076 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.264018 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.264720 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.264693 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.264810 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.264794 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.264932 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.264905 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.265002 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.264913 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.265451 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.265127 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.266389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.265702 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.266389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.265911 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config-out\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.266389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.266250 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.266389 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.266382 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.266641 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.266546 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.267422 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.267399 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-web-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.267590 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.267574 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.267649 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.267600 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-config\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.268256 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.268234 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.268491 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.268475 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.271023 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.271004 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qxnx6\" (UniqueName: \"kubernetes.io/projected/ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca-kube-api-access-qxnx6\") pod \"prometheus-k8s-0\" (UID: \"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca\") " pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.338551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.338518 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:08.385505 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.385473 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:08.436715 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.436688 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:08.523132 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:08.523106 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jun 12 18:27:08.525353 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:27:08.525301 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podea4df7be_f6b1_4ae6_9b6a_67c72bb394ca.slice/crio-dcb39636b91797d4887cea44f0731d30407d65922c561c9912cca78d63da9225 WatchSource:0}: Error finding container dcb39636b91797d4887cea44f0731d30407d65922c561c9912cca78d63da9225: Status 404 returned error can't find the container with id dcb39636b91797d4887cea44f0731d30407d65922c561c9912cca78d63da9225 Jun 12 18:27:09.019539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:09.019504 2575 generic.go:356] "Generic (PLEG): container finished" podID="ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca" containerID="2acb384bb803306c62a2d6bc4c3d93e462db6f051b0be92acfbd0a999468da20" exitCode=0 Jun 12 18:27:09.019986 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:09.019593 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerDied","Data":"2acb384bb803306c62a2d6bc4c3d93e462db6f051b0be92acfbd0a999468da20"} Jun 12 18:27:09.019986 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:09.019660 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"dcb39636b91797d4887cea44f0731d30407d65922c561c9912cca78d63da9225"} Jun 12 18:27:09.635409 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:09.635307 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="faddd42c-9b64-460f-bd5b-aea1b3f9f7a8" path="/var/lib/kubelet/pods/faddd42c-9b64-460f-bd5b-aea1b3f9f7a8/volumes" Jun 12 18:27:10.028480 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028444 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"18dc3351fd148666abed938938b65a85897db83513250783ceae6843659ea0e7"} Jun 12 18:27:10.028843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028508 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"f806a610af223932e17d8fbfe43c9732f43efb6f056d21ed9a6c67387dc50821"} Jun 12 18:27:10.028843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028534 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"8d067a29ba1c6ba0b1bd0d1f5c90c968a02d58ab5e0a2cfb92147cb8938bc6a5"} Jun 12 18:27:10.028843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028558 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"a32c1273bbb2aeaf25aaec7ac2b685850332e65751b6575ef30e247d11940aab"} Jun 12 18:27:10.028843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028584 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"79539dfd34363a28e1547fb498b02f8722ee33417db6ac36fe0cf1c4ed377f19"} Jun 12 18:27:10.028843 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.028608 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca","Type":"ContainerStarted","Data":"ed1538dc9e186871db7296824f2caf9ed380dfca7077b5d1d39e2b5e7784f3e1"} Jun 12 18:27:10.060397 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:10.060326 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.038271823 podStartE2EDuration="2.060305475s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.033652ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:27:08 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:27:10.059229822 +0000 UTC m=+320.915596721" watchObservedRunningTime="2026-06-12 18:27:10.060305475 +0000 UTC m=+320.916672377" Jun 12 18:27:11.307830 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:11.307798 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:11.417749 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:11.417707 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:13.314888 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:13.314850 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:13.385789 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:13.385745 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:27:13.417926 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:13.417896 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:15.795857 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:15.795822 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:15.853538 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:15.853502 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:26.311836 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:26.311796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:26.406893 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:26.406854 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:26.696918 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:26.696883 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:26.907709 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:26.907677 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:26.963242 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:26.963149 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:44.035874 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:44.035796 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:44.129587 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:44.129556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:52.832513 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:52.832478 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:27:52.889175 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:27:52.889132 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:08.386352 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:08.386303 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:28:08.402001 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:08.401973 2575 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:28:09.267374 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:09.267330 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jun 12 18:28:09.908618 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:09.908583 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:10.008745 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:10.008709 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:10.645606 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:10.645563 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:11.650864 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:11.650811 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:14.270224 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:14.270189 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:14.372400 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:14.372370 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:16.034101 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:16.034061 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:16.177412 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:16.177374 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:16.291675 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:16.291593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:19.516267 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:19.516236 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:19.733597 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:19.733564 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:19.901628 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:19.901542 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:21.263584 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:21.263547 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:21.353425 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:21.353390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:27.127010 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:27.126937 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:29.020692 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:29.020659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:29.117066 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:29.117036 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:30.350407 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.350372 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j"] Jun 12 18:28:30.354661 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.354643 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.357564 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.357542 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-r9n8p\"" Jun 12 18:28:30.358697 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.358678 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jun 12 18:28:30.358798 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.358688 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jun 12 18:28:30.365956 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.365929 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j"] Jun 12 18:28:30.457000 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.456966 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xdlbb\" (UniqueName: \"kubernetes.io/projected/89692129-7c22-4eb8-ba85-d4fb5664e459-kube-api-access-xdlbb\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.457000 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.457013 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89692129-7c22-4eb8-ba85-d4fb5664e459-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.557704 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.557673 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xdlbb\" (UniqueName: \"kubernetes.io/projected/89692129-7c22-4eb8-ba85-d4fb5664e459-kube-api-access-xdlbb\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.557879 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.557728 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89692129-7c22-4eb8-ba85-d4fb5664e459-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.558067 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.558050 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/89692129-7c22-4eb8-ba85-d4fb5664e459-tmp\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.568244 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.568217 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xdlbb\" (UniqueName: \"kubernetes.io/projected/89692129-7c22-4eb8-ba85-d4fb5664e459-kube-api-access-xdlbb\") pod \"openshift-lws-operator-fd8ccff4c-frm4j\" (UID: \"89692129-7c22-4eb8-ba85-d4fb5664e459\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.662959 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.662928 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" Jun 12 18:28:30.796367 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.796312 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j"] Jun 12 18:28:30.799622 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:28:30.799593 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod89692129_7c22_4eb8_ba85_d4fb5664e459.slice/crio-a3a51c1fed400baca69d60fcf958cc34ebce888f75c27db8456d94d7d92e28e9 WatchSource:0}: Error finding container a3a51c1fed400baca69d60fcf958cc34ebce888f75c27db8456d94d7d92e28e9: Status 404 returned error can't find the container with id a3a51c1fed400baca69d60fcf958cc34ebce888f75c27db8456d94d7d92e28e9 Jun 12 18:28:30.801060 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:30.801039 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:28:31.358430 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:31.358391 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" event={"ID":"89692129-7c22-4eb8-ba85-d4fb5664e459","Type":"ContainerStarted","Data":"a3a51c1fed400baca69d60fcf958cc34ebce888f75c27db8456d94d7d92e28e9"} Jun 12 18:28:34.372304 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:34.372264 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" event={"ID":"89692129-7c22-4eb8-ba85-d4fb5664e459","Type":"ContainerStarted","Data":"b9c2ed1f0072179715f4316b3d787c1d90b09f4e2a612eaba6f79db26eaa2406"} Jun 12 18:28:34.390618 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:34.390563 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-frm4j" podStartSLOduration=1.86468928 podStartE2EDuration="4.390546553s" totalImagesPullingTime="2.525857273s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:28:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:28:34.39026855 +0000 UTC m=+405.246635451" watchObservedRunningTime="2026-06-12 18:28:34.390546553 +0000 UTC m=+405.246913452" Jun 12 18:28:35.065552 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:35.065508 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:35.168332 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:35.168295 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:37.276542 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:37.276503 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:49.018205 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:49.018168 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:49.100560 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:49.100527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:53.544356 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.544305 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:53.661045 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.661011 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml"] Jun 12 18:28:53.663875 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.663859 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.669306 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.669282 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jun 12 18:28:53.669480 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.669286 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nsz6x\"" Jun 12 18:28:53.669480 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.669286 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jun 12 18:28:53.669932 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.669917 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jun 12 18:28:53.694771 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.694744 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml"] Jun 12 18:28:53.699046 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.699021 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:53.756303 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.756273 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dphw\" (UniqueName: \"kubernetes.io/projected/50bc8715-ad3d-45f0-9e65-5644a15debba-kube-api-access-6dphw\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.756486 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.756312 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-metrics-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.756486 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.756357 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bc8715-ad3d-45f0-9e65-5644a15debba-manager-config\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.756603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.756493 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.857451 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.857333 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dphw\" (UniqueName: \"kubernetes.io/projected/50bc8715-ad3d-45f0-9e65-5644a15debba-kube-api-access-6dphw\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.857451 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.857400 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-metrics-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.857451 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.857436 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bc8715-ad3d-45f0-9e65-5644a15debba-manager-config\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.857747 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.857503 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.858145 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.858118 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/50bc8715-ad3d-45f0-9e65-5644a15debba-manager-config\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.859933 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.859907 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-metrics-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.860025 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.859981 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/50bc8715-ad3d-45f0-9e65-5644a15debba-cert\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.870764 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.870743 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dphw\" (UniqueName: \"kubernetes.io/projected/50bc8715-ad3d-45f0-9e65-5644a15debba-kube-api-access-6dphw\") pod \"lws-controller-manager-dd95d798c-kqhml\" (UID: \"50bc8715-ad3d-45f0-9e65-5644a15debba\") " pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:53.972893 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:53.972856 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:54.109840 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.109810 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml"] Jun 12 18:28:54.112120 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:28:54.112091 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50bc8715_ad3d_45f0_9e65_5644a15debba.slice/crio-2d97f956549f3ea186bbc2ad2ed309a0391b66e1edc4c08d5bd5929b1b9705d3 WatchSource:0}: Error finding container 2d97f956549f3ea186bbc2ad2ed309a0391b66e1edc4c08d5bd5929b1b9705d3: Status 404 returned error can't find the container with id 2d97f956549f3ea186bbc2ad2ed309a0391b66e1edc4c08d5bd5929b1b9705d3 Jun 12 18:28:54.387214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.387123 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:54.447072 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.447033 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" event={"ID":"50bc8715-ad3d-45f0-9e65-5644a15debba","Type":"ContainerStarted","Data":"2d97f956549f3ea186bbc2ad2ed309a0391b66e1edc4c08d5bd5929b1b9705d3"} Jun 12 18:28:54.695599 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.695562 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:54.808365 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.808308 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:54.903261 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.903228 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9"] Jun 12 18:28:54.906804 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.906781 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:54.915811 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.915763 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jun 12 18:28:54.916054 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.916013 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jun 12 18:28:54.916170 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.916091 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jun 12 18:28:54.916659 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.916637 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jun 12 18:28:54.916659 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.916651 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fk847\"" Jun 12 18:28:54.966841 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.966755 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:54.966841 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.966800 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:54.967058 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.966914 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:54.967058 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.966975 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5k29g\" (UniqueName: \"kubernetes.io/projected/3fd1bdef-0c5a-47b4-b455-d30d3883462d-kube-api-access-5k29g\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:54.967058 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:54.967023 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.020736 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.020697 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9"] Jun 12 18:28:55.067483 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067433 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.067663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067541 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.067663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067596 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5k29g\" (UniqueName: \"kubernetes.io/projected/3fd1bdef-0c5a-47b4-b455-d30d3883462d-kube-api-access-5k29g\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.067663 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067622 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.067887 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067721 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.067939 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.067914 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-manifests\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.070249 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.070226 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3fd1bdef-0c5a-47b4-b455-d30d3883462d-tmp\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.070462 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.070441 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-webhook-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.070582 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.070560 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/3fd1bdef-0c5a-47b4-b455-d30d3883462d-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.086412 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.086383 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5k29g\" (UniqueName: \"kubernetes.io/projected/3fd1bdef-0c5a-47b4-b455-d30d3883462d-kube-api-access-5k29g\") pod \"opendatahub-operator-controller-manager-5877f56774-d6jj9\" (UID: \"3fd1bdef-0c5a-47b4-b455-d30d3883462d\") " pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.139544 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.139501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.220149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.220062 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:28:55.234816 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.234784 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.339924 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.339892 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.437510 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.437482 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.536987 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.536955 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.575824 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.575798 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9"] Jun 12 18:28:55.577966 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:28:55.577941 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fd1bdef_0c5a_47b4_b455_d30d3883462d.slice/crio-01b45677e38bc80c65142a251045b72e177d51874ead192de677db071fe2b9df WatchSource:0}: Error finding container 01b45677e38bc80c65142a251045b72e177d51874ead192de677db071fe2b9df: Status 404 returned error can't find the container with id 01b45677e38bc80c65142a251045b72e177d51874ead192de677db071fe2b9df Jun 12 18:28:55.640120 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.640091 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:55.777442 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:55.777321 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:28:56.457864 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:56.457812 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" event={"ID":"50bc8715-ad3d-45f0-9e65-5644a15debba","Type":"ContainerStarted","Data":"37577fef297e93d57a50760a69ba6d7847534eda93a32107ccbac430dffced3a"} Jun 12 18:28:56.458067 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:56.457872 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:28:56.459349 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:56.459302 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" event={"ID":"3fd1bdef-0c5a-47b4-b455-d30d3883462d","Type":"ContainerStarted","Data":"01b45677e38bc80c65142a251045b72e177d51874ead192de677db071fe2b9df"} Jun 12 18:28:56.477700 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:56.477644 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" podStartSLOduration=2.089561511 podStartE2EDuration="3.477624987s" totalImagesPullingTime="1.388063476s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:28:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:28:56.475453264 +0000 UTC m=+427.331820177" watchObservedRunningTime="2026-06-12 18:28:56.477624987 +0000 UTC m=+427.333991889" Jun 12 18:28:58.471381 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:58.471321 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" event={"ID":"3fd1bdef-0c5a-47b4-b455-d30d3883462d","Type":"ContainerStarted","Data":"207f6a376fcd5b04cc7903b74e664507baebddb40398882a4421dbf717c97562"} Jun 12 18:28:59.477383 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:59.477316 2575 generic.go:356] "Generic (PLEG): container finished" podID="3fd1bdef-0c5a-47b4-b455-d30d3883462d" containerID="207f6a376fcd5b04cc7903b74e664507baebddb40398882a4421dbf717c97562" exitCode=0 Jun 12 18:28:59.477790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:28:59.477402 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" event={"ID":"3fd1bdef-0c5a-47b4-b455-d30d3883462d","Type":"ContainerDied","Data":"207f6a376fcd5b04cc7903b74e664507baebddb40398882a4421dbf717c97562"} Jun 12 18:29:00.484822 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:00.484787 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" event={"ID":"3fd1bdef-0c5a-47b4-b455-d30d3883462d","Type":"ContainerStarted","Data":"7f5dd0c25c8174a0b50329604c2e83edcb4c19fde142f773f0bdee767fb636ce"} Jun 12 18:29:00.485212 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:00.484867 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:29:00.522869 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:00.522821 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" podStartSLOduration=2.5547319379999998 podStartE2EDuration="6.522807329s" totalImagesPullingTime="3.050599603s" totalInitContainerRuntime="917.475788ms" isStatefulPod=false podCreationTimestamp="2026-06-12 18:28:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:00.522000883 +0000 UTC m=+431.378367782" watchObservedRunningTime="2026-06-12 18:29:00.522807329 +0000 UTC m=+431.379174228" Jun 12 18:29:07.467419 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:07.467387 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-dd95d798c-kqhml" Jun 12 18:29:11.492427 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:11.492390 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5877f56774-d6jj9" Jun 12 18:29:14.108923 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:14.108879 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:14.306783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:14.306751 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:19.706415 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.706381 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:19.807139 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.807096 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:19.875869 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.875823 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:19.890459 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.890426 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f"] Jun 12 18:29:19.893850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.893830 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:19.896558 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.896533 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jun 12 18:29:19.897565 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.897543 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jun 12 18:29:19.897673 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.897541 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-8xpvz\"" Jun 12 18:29:19.897737 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.897547 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jun 12 18:29:19.897828 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.897811 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jun 12 18:29:19.905610 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.905589 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f"] Jun 12 18:29:19.987376 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.987252 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90f7d35-ae12-4acc-ae67-694c3d455646-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:19.987376 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.987291 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b90f7d35-ae12-4acc-ae67-694c3d455646-tmp\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:19.987610 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:19.987387 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlhjk\" (UniqueName: \"kubernetes.io/projected/b90f7d35-ae12-4acc-ae67-694c3d455646-kube-api-access-hlhjk\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.077780 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.077740 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:20.088029 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.088001 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlhjk\" (UniqueName: \"kubernetes.io/projected/b90f7d35-ae12-4acc-ae67-694c3d455646-kube-api-access-hlhjk\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.088214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.088086 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90f7d35-ae12-4acc-ae67-694c3d455646-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.088214 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.088110 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b90f7d35-ae12-4acc-ae67-694c3d455646-tmp\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.090813 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.090786 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b90f7d35-ae12-4acc-ae67-694c3d455646-tls-certs\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.090940 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.090788 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b90f7d35-ae12-4acc-ae67-694c3d455646-tmp\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.101204 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.101171 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlhjk\" (UniqueName: \"kubernetes.io/projected/b90f7d35-ae12-4acc-ae67-694c3d455646-kube-api-access-hlhjk\") pod \"kube-auth-proxy-6bf5d68d87-wjd8f\" (UID: \"b90f7d35-ae12-4acc-ae67-694c3d455646\") " pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.173132 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.173097 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:20.203444 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.203413 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" Jun 12 18:29:20.271472 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.271385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:20.343050 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.343012 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f"] Jun 12 18:29:20.345753 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:29:20.345712 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb90f7d35_ae12_4acc_ae67_694c3d455646.slice/crio-9e02d019c8eefc30eddbc8b92d8c7bd5483c57ea1a31e5c54361b859d9009709 WatchSource:0}: Error finding container 9e02d019c8eefc30eddbc8b92d8c7bd5483c57ea1a31e5c54361b859d9009709: Status 404 returned error can't find the container with id 9e02d019c8eefc30eddbc8b92d8c7bd5483c57ea1a31e5c54361b859d9009709 Jun 12 18:29:20.568358 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.568251 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" event={"ID":"b90f7d35-ae12-4acc-ae67-694c3d455646","Type":"ContainerStarted","Data":"9e02d019c8eefc30eddbc8b92d8c7bd5483c57ea1a31e5c54361b859d9009709"} Jun 12 18:29:20.683995 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.683953 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:20.953381 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:20.953320 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:23.582961 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:23.582921 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" event={"ID":"b90f7d35-ae12-4acc-ae67-694c3d455646","Type":"ContainerStarted","Data":"1c861ebba3fc8a9962db2992f8529c401c92d1f4ec88586fe5b75e9a5450a273"} Jun 12 18:29:23.601936 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:23.601888 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6bf5d68d87-wjd8f" podStartSLOduration=1.58864165 podStartE2EDuration="4.601874542s" totalImagesPullingTime="3.013232892s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:29:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:29:23.600754932 +0000 UTC m=+454.457121845" watchObservedRunningTime="2026-06-12 18:29:23.601874542 +0000 UTC m=+454.458241440" Jun 12 18:29:30.488628 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:30.488592 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:30.604602 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:30.604572 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:30.762409 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:30.762300 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:30.946657 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:30.946623 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:31.065183 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:31.065101 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:34.098099 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:34.098062 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:34.254718 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:34.254680 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:35.980144 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:35.980108 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:36.106092 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:36.106048 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:36.254871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:36.254783 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:36.527539 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:36.527455 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:36.766602 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:36.766570 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:46.806043 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:46.806009 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:46.868060 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:46.868029 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:49.061600 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:49.061557 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:49.136416 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:49.136385 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:49.669673 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:49.669638 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:51.105461 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:51.105423 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:51.183026 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:51.182993 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:52.536384 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:52.536353 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:52.635630 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:52.635584 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:52.924886 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:52.924844 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:53.087871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:53.087819 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:53.383711 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:53.383601 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:29:57.792599 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:29:57.792556 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:00.243508 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:00.243472 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:00.341752 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:00.341710 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:15.656720 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:15.656679 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:15.752963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:15.752932 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:15.901920 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:15.901886 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:22.775579 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:22.775539 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:22.825433 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:22.825399 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:24.717537 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:24.717501 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:24.772494 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:24.772458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:43.493712 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:43.493613 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:45.788178 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:45.788146 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:47.686496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:47.686462 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:51.682352 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:51.682275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:51.936478 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:51.936383 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:52.281653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:52.281572 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:30:56.695207 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:30:56.695174 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:00.727241 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:00.727209 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:00.791594 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:00.791544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:00.872783 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:00.872749 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:00.974559 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:00.974527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:01.493139 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:01.493100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:01.601047 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:01.601014 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:03.147081 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:03.147043 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:03.248411 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:03.248368 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:04.516627 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:04.516593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:04.631565 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:04.631527 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:05.375196 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:05.375162 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:07.746613 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:07.746576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:08.695669 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:08.695636 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:08.794415 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:08.794379 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:11.930613 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:11.930576 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:11.983307 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:11.983275 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:12.049255 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.049222 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:12.542808 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.542773 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv"] Jun 12 18:31:12.545880 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.545857 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.548086 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.548057 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:12.548425 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.548409 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\"" Jun 12 18:31:12.548525 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.548458 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jun 12 18:31:12.548633 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.548619 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\"" Jun 12 18:31:12.548699 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.548682 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-zvbn7\"" Jun 12 18:31:12.549623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.549607 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jun 12 18:31:12.553851 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.553833 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv"] Jun 12 18:31:12.632376 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.632315 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-62wrn\" (UniqueName: \"kubernetes.io/projected/61b2c8e4-7f62-42bc-821c-8b02e61d5891-kube-api-access-62wrn\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.632376 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.632378 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61b2c8e4-7f62-42bc-821c-8b02e61d5891-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.632600 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.632420 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.733484 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.733449 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-62wrn\" (UniqueName: \"kubernetes.io/projected/61b2c8e4-7f62-42bc-821c-8b02e61d5891-kube-api-access-62wrn\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.733484 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.733484 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61b2c8e4-7f62-42bc-821c-8b02e61d5891-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.733720 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.733509 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.733720 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:12.733607 2575 secret.go:189] Couldn't get secret kuadrant-system/plugin-serving-cert: secret "plugin-serving-cert" not found Jun 12 18:31:12.733720 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:12.733670 2575 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert podName:61b2c8e4-7f62-42bc-821c-8b02e61d5891 nodeName:}" failed. No retries permitted until 2026-06-12 18:31:13.233652139 +0000 UTC m=+564.090019020 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "plugin-serving-cert" (UniqueName: "kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert") pod "kuadrant-console-plugin-66b5774985-zrztv" (UID: "61b2c8e4-7f62-42bc-821c-8b02e61d5891") : secret "plugin-serving-cert" not found Jun 12 18:31:12.734143 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.734121 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/61b2c8e4-7f62-42bc-821c-8b02e61d5891-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.743963 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.743937 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-62wrn\" (UniqueName: \"kubernetes.io/projected/61b2c8e4-7f62-42bc-821c-8b02e61d5891-kube-api-access-62wrn\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:12.895715 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:12.895626 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:13.081852 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.081820 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:13.138009 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.137973 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:13.238096 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.238059 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:13.240819 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.240790 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/61b2c8e4-7f62-42bc-821c-8b02e61d5891-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zrztv\" (UID: \"61b2c8e4-7f62-42bc-821c-8b02e61d5891\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:13.456711 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.456677 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" Jun 12 18:31:13.482137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.482104 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:13.543400 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.543365 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:13.585078 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:13.585044 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv"] Jun 12 18:31:13.588413 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:31:13.588384 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod61b2c8e4_7f62_42bc_821c_8b02e61d5891.slice/crio-b57fcaddced67db2e6ea17d201c9acafcce5fc3e37e4953ee3600fdf34f8315a WatchSource:0}: Error finding container b57fcaddced67db2e6ea17d201c9acafcce5fc3e37e4953ee3600fdf34f8315a: Status 404 returned error can't find the container with id b57fcaddced67db2e6ea17d201c9acafcce5fc3e37e4953ee3600fdf34f8315a Jun 12 18:31:14.054053 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:14.054017 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" event={"ID":"61b2c8e4-7f62-42bc-821c-8b02e61d5891","Type":"ContainerStarted","Data":"b57fcaddced67db2e6ea17d201c9acafcce5fc3e37e4953ee3600fdf34f8315a"} Jun 12 18:31:17.292407 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:17.292367 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:17.392624 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:17.392585 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:22.283039 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.283001 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv"] Jun 12 18:31:22.286137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.286119 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.289247 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.289220 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jwh5r\"" Jun 12 18:31:22.305911 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.305879 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv"] Jun 12 18:31:22.430802 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.430764 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.430991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.430827 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v8wlq\" (UniqueName: \"kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.531654 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.531607 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v8wlq\" (UniqueName: \"kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.531844 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.531703 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.532088 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.532068 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.541254 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.541173 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-v8wlq\" (UniqueName: \"kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq\") pod \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.596768 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.596722 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:22.785251 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.785214 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv"] Jun 12 18:31:22.789350 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:31:22.789308 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod418274b8_b11e_40ee_ac9c_1f7371409b91.slice/crio-c2dfc8a24f1ebbdda81207315538aef882307c4bdef5c17b7bf3b3919ad77b12 WatchSource:0}: Error finding container c2dfc8a24f1ebbdda81207315538aef882307c4bdef5c17b7bf3b3919ad77b12: Status 404 returned error can't find the container with id c2dfc8a24f1ebbdda81207315538aef882307c4bdef5c17b7bf3b3919ad77b12 Jun 12 18:31:22.803775 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.803738 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv"] Jun 12 18:31:22.825178 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.825140 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv"] Jun 12 18:31:22.867149 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.867115 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:31:22.871785 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.871756 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:22.884484 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.884451 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:22.895800 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.895758 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:31:22.995068 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:22.995038 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:23.037232 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.037186 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-97sr7\" (UniqueName: \"kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.037232 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.037247 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.138795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.138693 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-97sr7\" (UniqueName: \"kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.138795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.138738 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.139230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.139206 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.153262 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.153235 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-97sr7\" (UniqueName: \"kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7\") pod \"kuadrant-operator-controller-manager-55467d9f7-skrn5\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.186130 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.186089 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:23.344862 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.344830 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:31:23.348034 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:31:23.348005 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96e9b4ec_ce51_4f26_bdb1_8d41466aaa16.slice/crio-f27d4e32c1ee3e9cd362f1856ae955b90af94ca4e33bf5cd2882d7d2da5280e3 WatchSource:0}: Error finding container f27d4e32c1ee3e9cd362f1856ae955b90af94ca4e33bf5cd2882d7d2da5280e3: Status 404 returned error can't find the container with id f27d4e32c1ee3e9cd362f1856ae955b90af94ca4e33bf5cd2882d7d2da5280e3 Jun 12 18:31:23.881889 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.881849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:23.991252 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:23.991221 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:24.105488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:24.105452 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" event={"ID":"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16","Type":"ContainerStarted","Data":"f27d4e32c1ee3e9cd362f1856ae955b90af94ca4e33bf5cd2882d7d2da5280e3"} Jun 12 18:31:25.192110 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:25.192069 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:25.292962 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:25.292911 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:28.283812 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:28.283776 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:28.384606 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:28.384484 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:32.786040 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:32.786005 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:32.886298 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:32.886253 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:36.342250 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:36.342201 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:36.442354 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:36.442294 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:42.194119 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.194061 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" containerName="manager" containerID="cri-o://7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf" gracePeriod=2 Jun 12 18:31:42.195839 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.195807 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" event={"ID":"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16","Type":"ContainerStarted","Data":"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367"} Jun 12 18:31:42.195992 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.195882 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:42.196649 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:42.196620 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:42.197469 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.197443 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" event={"ID":"61b2c8e4-7f62-42bc-821c-8b02e61d5891","Type":"ContainerStarted","Data":"83b39651c90a218ed406049c2803a993d120dd810ec31e16ff2429cd13f31eac"} Jun 12 18:31:42.199050 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:42.198734 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:42.219957 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.219901 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" podStartSLOduration=2.21313663 podStartE2EDuration="20.21988396s" totalImagesPullingTime="18.00674733s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:42.218037065 +0000 UTC m=+593.074403967" watchObservedRunningTime="2026-06-12 18:31:42.21988396 +0000 UTC m=+593.076250859" Jun 12 18:31:42.234674 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.234624 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zrztv" podStartSLOduration=2.453371733 podStartE2EDuration="30.234611709s" totalImagesPullingTime="27.781239976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:31:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:31:42.23382351 +0000 UTC m=+593.090190411" watchObservedRunningTime="2026-06-12 18:31:42.234611709 +0000 UTC m=+593.090978608" Jun 12 18:31:42.235999 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:42.235974 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:42.443145 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.443117 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:42.445643 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:42.445582 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:42.529102 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.529057 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume\") pod \"418274b8-b11e-40ee-ac9c-1f7371409b91\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " Jun 12 18:31:42.529271 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.529134 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-v8wlq\" (UniqueName: \"kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq\") pod \"418274b8-b11e-40ee-ac9c-1f7371409b91\" (UID: \"418274b8-b11e-40ee-ac9c-1f7371409b91\") " Jun 12 18:31:42.529443 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.529424 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "418274b8-b11e-40ee-ac9c-1f7371409b91" (UID: "418274b8-b11e-40ee-ac9c-1f7371409b91"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:31:42.531314 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.531288 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq" (OuterVolumeSpecName: "kube-api-access-v8wlq") pod "418274b8-b11e-40ee-ac9c-1f7371409b91" (UID: "418274b8-b11e-40ee-ac9c-1f7371409b91"). InnerVolumeSpecName "kube-api-access-v8wlq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:31:42.630670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.630632 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/418274b8-b11e-40ee-ac9c-1f7371409b91-extensions-socket-volume\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:31:42.630670 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.630663 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-v8wlq\" (UniqueName: \"kubernetes.io/projected/418274b8-b11e-40ee-ac9c-1f7371409b91-kube-api-access-v8wlq\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:31:42.975137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:42.975100 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:43.074851 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.074818 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:43.203261 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.203223 2575 generic.go:356] "Generic (PLEG): container finished" podID="418274b8-b11e-40ee-ac9c-1f7371409b91" containerID="7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf" exitCode=2 Jun 12 18:31:43.203261 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.203265 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:43.203770 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.203282 2575 scope.go:117] "RemoveContainer" containerID="7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf" Jun 12 18:31:43.207691 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:43.207660 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:43.213106 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.213090 2575 scope.go:117] "RemoveContainer" containerID="7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf" Jun 12 18:31:43.213364 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:43.213323 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf\": container with ID starting with 7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf not found: ID does not exist" containerID="7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf" Jun 12 18:31:43.213427 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.213376 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf"} err="failed to get container status \"7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf\": rpc error: code = NotFound desc = could not find container \"7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf\": container with ID starting with 7e23c08dd9f43a47964063e0f384279530b1837ca612939cc5b3757ba21a1fdf not found: ID does not exist" Jun 12 18:31:43.214655 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:31:43.214631 2575 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-sq2fv\" is forbidden: User \"system:node:ip-10-0-138-101.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-101.ec2.internal' and this object" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-sq2fv" Jun 12 18:31:43.635814 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:43.635779 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" path="/var/lib/kubelet/pods/418274b8-b11e-40ee-ac9c-1f7371409b91/volumes" Jun 12 18:31:46.180517 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:46.180483 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:46.280976 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:46.280936 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:49.604164 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:49.604139 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:31:49.604601 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:49.604139 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:31:50.776795 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:50.776756 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:50.871575 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:50.871540 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:50.974570 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:50.974536 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:51.033684 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:51.033593 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:53.206271 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:53.206235 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:31:56.191452 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:56.191417 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:31:56.290497 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:31:56.290465 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:05.361750 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.361704 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:32:05.362248 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.361977 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" podUID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" containerName="manager" containerID="cri-o://471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367" gracePeriod=10 Jun 12 18:32:05.615101 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.615030 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:32:05.737231 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.737195 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-97sr7\" (UniqueName: \"kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7\") pod \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " Jun 12 18:32:05.737447 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.737256 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume\") pod \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\" (UID: \"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16\") " Jun 12 18:32:05.737681 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.737656 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" (UID: "96e9b4ec-ce51-4f26-bdb1-8d41466aaa16"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jun 12 18:32:05.739488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.739463 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7" (OuterVolumeSpecName: "kube-api-access-97sr7") pod "96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" (UID: "96e9b4ec-ce51-4f26-bdb1-8d41466aaa16"). InnerVolumeSpecName "kube-api-access-97sr7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:32:05.838639 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.838599 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-97sr7\" (UniqueName: \"kubernetes.io/projected/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-kube-api-access-97sr7\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:32:05.838639 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:05.838634 2575 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16-extensions-socket-volume\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:32:06.307678 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.307643 2575 generic.go:356] "Generic (PLEG): container finished" podID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" containerID="471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367" exitCode=0 Jun 12 18:32:06.307863 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.307689 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" Jun 12 18:32:06.307863 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.307704 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" event={"ID":"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16","Type":"ContainerDied","Data":"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367"} Jun 12 18:32:06.307863 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.307746 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5" event={"ID":"96e9b4ec-ce51-4f26-bdb1-8d41466aaa16","Type":"ContainerDied","Data":"f27d4e32c1ee3e9cd362f1856ae955b90af94ca4e33bf5cd2882d7d2da5280e3"} Jun 12 18:32:06.307863 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.307767 2575 scope.go:117] "RemoveContainer" containerID="471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367" Jun 12 18:32:06.316656 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.316637 2575 scope.go:117] "RemoveContainer" containerID="471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367" Jun 12 18:32:06.316911 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:32:06.316893 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367\": container with ID starting with 471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367 not found: ID does not exist" containerID="471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367" Jun 12 18:32:06.316954 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.316920 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367"} err="failed to get container status \"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367\": rpc error: code = NotFound desc = could not find container \"471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367\": container with ID starting with 471130af49b22d12abb5ed575318e6cc6c2b8c905d4e66b504f679e70c80a367 not found: ID does not exist" Jun 12 18:32:06.330200 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.330174 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:32:06.334161 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:06.334137 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-skrn5"] Jun 12 18:32:07.635502 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:07.635469 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" path="/var/lib/kubelet/pods/96e9b4ec-ce51-4f26-bdb1-8d41466aaa16/volumes" Jun 12 18:32:09.540597 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:09.540510 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:09.907239 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:09.907199 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:13.905444 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.905409 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:13.908390 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908362 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:13.908681 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908669 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" containerName="manager" Jun 12 18:32:13.908725 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908682 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" containerName="manager" Jun 12 18:32:13.908725 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908708 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" containerName="manager" Jun 12 18:32:13.908725 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908714 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" containerName="manager" Jun 12 18:32:13.908821 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908779 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="96e9b4ec-ce51-4f26-bdb1-8d41466aaa16" containerName="manager" Jun 12 18:32:13.908821 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:13.908789 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="418274b8-b11e-40ee-ac9c-1f7371409b91" containerName="manager" Jun 12 18:32:14.016279 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.016240 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:14.115761 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.115727 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:14.195187 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.195098 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:14.195187 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.195168 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:14.195187 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.195110 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.197991 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.197960 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jun 12 18:32:14.205931 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.205906 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szb9g\" (UniqueName: \"kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.206048 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.205959 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.306727 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.306689 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.306945 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.306789 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szb9g\" (UniqueName: \"kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.307328 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.307305 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.316922 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.316896 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-szb9g\" (UniqueName: \"kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g\") pod \"limitador-limitador-64c94fd64f-llw2p\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.505870 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.505778 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:14.656976 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.656944 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:14.660315 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:32:14.660287 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda2e4991_1477_4bfa_89ae_1c8a37adb9b0.slice/crio-432b4080ca78703170f18dbcebe620736950b9b4cd10ce5ad1926b1cff35eb3e WatchSource:0}: Error finding container 432b4080ca78703170f18dbcebe620736950b9b4cd10ce5ad1926b1cff35eb3e: Status 404 returned error can't find the container with id 432b4080ca78703170f18dbcebe620736950b9b4cd10ce5ad1926b1cff35eb3e Jun 12 18:32:14.757363 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.757244 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:14.817488 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:14.817457 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:15.361925 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:15.361831 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" event={"ID":"da2e4991-1477-4bfa-89ae-1c8a37adb9b0","Type":"ContainerStarted","Data":"432b4080ca78703170f18dbcebe620736950b9b4cd10ce5ad1926b1cff35eb3e"} Jun 12 18:32:17.372636 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:17.372594 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" event={"ID":"da2e4991-1477-4bfa-89ae-1c8a37adb9b0","Type":"ContainerStarted","Data":"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff"} Jun 12 18:32:17.373072 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:17.372667 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:17.392790 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:17.392717 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" podStartSLOduration=1.830606987 podStartE2EDuration="4.392698739s" totalImagesPullingTime="2.562091752s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:17.391513425 +0000 UTC m=+628.247880321" watchObservedRunningTime="2026-06-12 18:32:17.392698739 +0000 UTC m=+628.249065637" Jun 12 18:32:28.377810 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:28.377779 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:29.465506 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:29.465465 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:29.465914 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:29.465671 2575 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" podUID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" containerName="limitador" containerID="cri-o://30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff" gracePeriod=30 Jun 12 18:32:30.013252 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.013220 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:30.141235 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.141139 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file\") pod \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " Jun 12 18:32:30.141445 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.141243 2575 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szb9g\" (UniqueName: \"kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g\") pod \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\" (UID: \"da2e4991-1477-4bfa-89ae-1c8a37adb9b0\") " Jun 12 18:32:30.141536 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.141513 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file" (OuterVolumeSpecName: "config-file") pod "da2e4991-1477-4bfa-89ae-1c8a37adb9b0" (UID: "da2e4991-1477-4bfa-89ae-1c8a37adb9b0"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jun 12 18:32:30.143267 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.143241 2575 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g" (OuterVolumeSpecName: "kube-api-access-szb9g") pod "da2e4991-1477-4bfa-89ae-1c8a37adb9b0" (UID: "da2e4991-1477-4bfa-89ae-1c8a37adb9b0"). InnerVolumeSpecName "kube-api-access-szb9g". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jun 12 18:32:30.242442 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.242408 2575 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szb9g\" (UniqueName: \"kubernetes.io/projected/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-kube-api-access-szb9g\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:32:30.242442 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.242435 2575 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/da2e4991-1477-4bfa-89ae-1c8a37adb9b0-config-file\") on node \"ip-10-0-138-101.ec2.internal\" DevicePath \"\"" Jun 12 18:32:30.430485 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.430454 2575 generic.go:356] "Generic (PLEG): container finished" podID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" containerID="30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff" exitCode=0 Jun 12 18:32:30.430683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.430498 2575 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" Jun 12 18:32:30.430683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.430543 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" event={"ID":"da2e4991-1477-4bfa-89ae-1c8a37adb9b0","Type":"ContainerDied","Data":"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff"} Jun 12 18:32:30.430683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.430630 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-llw2p" event={"ID":"da2e4991-1477-4bfa-89ae-1c8a37adb9b0","Type":"ContainerDied","Data":"432b4080ca78703170f18dbcebe620736950b9b4cd10ce5ad1926b1cff35eb3e"} Jun 12 18:32:30.430683 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.430659 2575 scope.go:117] "RemoveContainer" containerID="30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff" Jun 12 18:32:30.439145 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.439126 2575 scope.go:117] "RemoveContainer" containerID="30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff" Jun 12 18:32:30.439455 ip-10-0-138-101 kubenswrapper[2575]: E0612 18:32:30.439432 2575 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff\": container with ID starting with 30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff not found: ID does not exist" containerID="30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff" Jun 12 18:32:30.439506 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.439465 2575 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff"} err="failed to get container status \"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff\": rpc error: code = NotFound desc = could not find container \"30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff\": container with ID starting with 30a646277c4755bc97d62f0f2cad3eba56ab61ba15d72b4fe8b2954e259f33ff not found: ID does not exist" Jun 12 18:32:30.452742 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.452706 2575 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:30.457015 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:30.456989 2575 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-llw2p"] Jun 12 18:32:31.635405 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:31.635375 2575 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" path="/var/lib/kubelet/pods/da2e4991-1477-4bfa-89ae-1c8a37adb9b0/volumes" Jun 12 18:32:32.215052 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.215014 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-5lqnh"] Jun 12 18:32:32.215359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.215329 2575 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" containerName="limitador" Jun 12 18:32:32.215413 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.215361 2575 state_mem.go:107] "Deleted CPUSet assignment" podUID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" containerName="limitador" Jun 12 18:32:32.215458 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.215435 2575 memory_manager.go:368] "RemoveStaleState removing state" podUID="da2e4991-1477-4bfa-89ae-1c8a37adb9b0" containerName="limitador" Jun 12 18:32:32.219786 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.219766 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.222394 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.222371 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-chxvn\"" Jun 12 18:32:32.222508 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.222373 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\"" Jun 12 18:32:32.225844 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.225793 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5lqnh"] Jun 12 18:32:32.247086 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.247052 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:32.260221 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.260194 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nf8fr\" (UniqueName: \"kubernetes.io/projected/0b914680-2e24-43dd-95ed-a969f011c15b-kube-api-access-nf8fr\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.260305 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.260234 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b914680-2e24-43dd-95ed-a969f011c15b-data\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.361603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.361563 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nf8fr\" (UniqueName: \"kubernetes.io/projected/0b914680-2e24-43dd-95ed-a969f011c15b-kube-api-access-nf8fr\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.361794 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.361615 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b914680-2e24-43dd-95ed-a969f011c15b-data\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.362040 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.362019 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0b914680-2e24-43dd-95ed-a969f011c15b-data\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.370073 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.370044 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nf8fr\" (UniqueName: \"kubernetes.io/projected/0b914680-2e24-43dd-95ed-a969f011c15b-kube-api-access-nf8fr\") pod \"postgres-69fb4594cf-5lqnh\" (UID: \"0b914680-2e24-43dd-95ed-a969f011c15b\") " pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.532623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.532540 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:32.661286 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:32.661259 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-5lqnh"] Jun 12 18:32:32.663224 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:32:32.663196 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b914680_2e24_43dd_95ed_a969f011c15b.slice/crio-c04b53cca56ce43e7a222a25d3c8b268148a7343081f94120dfd25ce74e70adb WatchSource:0}: Error finding container c04b53cca56ce43e7a222a25d3c8b268148a7343081f94120dfd25ce74e70adb: Status 404 returned error can't find the container with id c04b53cca56ce43e7a222a25d3c8b268148a7343081f94120dfd25ce74e70adb Jun 12 18:32:33.445000 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:33.444965 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5lqnh" event={"ID":"0b914680-2e24-43dd-95ed-a969f011c15b","Type":"ContainerStarted","Data":"c04b53cca56ce43e7a222a25d3c8b268148a7343081f94120dfd25ce74e70adb"} Jun 12 18:32:39.474519 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:39.474483 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-5lqnh" event={"ID":"0b914680-2e24-43dd-95ed-a969f011c15b","Type":"ContainerStarted","Data":"24fc3afc7528df21ad970802ce02b17fa89bef9fb69c87d6c0b0c3ffc074d5a0"} Jun 12 18:32:39.474966 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:39.474623 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:39.502396 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:39.502328 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-5lqnh" podStartSLOduration=1.595811885 podStartE2EDuration="7.50231156s" totalImagesPullingTime="5.906499675s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:32:39.502159702 +0000 UTC m=+650.358526599" watchObservedRunningTime="2026-06-12 18:32:39.50231156 +0000 UTC m=+650.358678458" Jun 12 18:32:45.512368 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:45.512321 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-5lqnh" Jun 12 18:32:45.847634 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:45.847544 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:45.952499 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:45.952468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:46.091971 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:46.091927 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:32:55.013490 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.013453 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-77gk5"] Jun 12 18:32:55.021893 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.021873 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" Jun 12 18:32:55.025607 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.025579 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"openshift-service-ca.crt\"" Jun 12 18:32:55.025746 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.025628 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"keycloak-system\"/\"kube-root-ca.crt\"" Jun 12 18:32:55.025746 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.025659 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"keycloak-system\"/\"keycloak-operator-dockercfg-ctmqh\"" Jun 12 18:32:55.025979 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.025957 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-77gk5"] Jun 12 18:32:55.165044 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.165007 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-94bgg\" (UniqueName: \"kubernetes.io/projected/be177fc9-469b-48a3-a1f1-6da27f844e95-kube-api-access-94bgg\") pod \"keycloak-operator-d67dbbb48-77gk5\" (UID: \"be177fc9-469b-48a3-a1f1-6da27f844e95\") " pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" Jun 12 18:32:55.266086 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.266000 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-94bgg\" (UniqueName: \"kubernetes.io/projected/be177fc9-469b-48a3-a1f1-6da27f844e95-kube-api-access-94bgg\") pod \"keycloak-operator-d67dbbb48-77gk5\" (UID: \"be177fc9-469b-48a3-a1f1-6da27f844e95\") " pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" Jun 12 18:32:55.276472 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.276438 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-94bgg\" (UniqueName: \"kubernetes.io/projected/be177fc9-469b-48a3-a1f1-6da27f844e95-kube-api-access-94bgg\") pod \"keycloak-operator-d67dbbb48-77gk5\" (UID: \"be177fc9-469b-48a3-a1f1-6da27f844e95\") " pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" Jun 12 18:32:55.332419 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.332392 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" Jun 12 18:32:55.458055 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.458017 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["keycloak-system/keycloak-operator-d67dbbb48-77gk5"] Jun 12 18:32:55.460732 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:32:55.460706 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe177fc9_469b_48a3_a1f1_6da27f844e95.slice/crio-3fbe63b7a9d747b7f65184211fd34530765075dcc85f39ce22d0ab551f6442a8 WatchSource:0}: Error finding container 3fbe63b7a9d747b7f65184211fd34530765075dcc85f39ce22d0ab551f6442a8: Status 404 returned error can't find the container with id 3fbe63b7a9d747b7f65184211fd34530765075dcc85f39ce22d0ab551f6442a8 Jun 12 18:32:55.548961 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:32:55.548876 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" event={"ID":"be177fc9-469b-48a3-a1f1-6da27f844e95","Type":"ContainerStarted","Data":"3fbe63b7a9d747b7f65184211fd34530765075dcc85f39ce22d0ab551f6442a8"} Jun 12 18:33:01.581528 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:01.581429 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" event={"ID":"be177fc9-469b-48a3-a1f1-6da27f844e95","Type":"ContainerStarted","Data":"4ee8031c15877bd859024088e971b099a879a4936b69c95ce40831d0ebb6e627"} Jun 12 18:33:01.601137 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:01.601088 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="keycloak-system/keycloak-operator-d67dbbb48-77gk5" podStartSLOduration=1.781977318 podStartE2EDuration="7.601073655s" totalImagesPullingTime="5.819096337s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:32:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:33:01.600815318 +0000 UTC m=+672.457182217" watchObservedRunningTime="2026-06-12 18:33:01.601073655 +0000 UTC m=+672.457440554" Jun 12 18:33:10.277040 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:10.277001 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:10.374567 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:10.374538 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:40.748905 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:40.748809 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:41.100936 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:41.100849 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:46.222127 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:46.222087 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:46.302303 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:46.302270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:46.363864 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:46.363830 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:48.077554 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:48.077519 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:49.621266 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:49.621230 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:33:49.718130 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:33:49.718099 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:34:20.684631 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:34:20.684595 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:34:20.917692 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:34:20.917659 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:34:21.123469 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:34:21.123380 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:34:21.209594 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:34:21.209560 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:34:45.682504 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:34:45.682468 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:35:22.239987 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:35:22.239949 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:35:22.327686 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:35:22.327650 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:35:37.804551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:35:37.804513 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:35:37.960675 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:35:37.960642 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:35:49.197524 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:35:49.197487 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:36:07.741511 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:07.741477 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:36:16.441427 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:16.441390 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:36:25.347614 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:25.347582 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:36:49.630011 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:49.629935 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:36:49.632895 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:49.632868 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:36:54.863822 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:36:54.863785 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:37:06.033496 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:37:06.033458 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:10.201118 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:10.201086 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:10.295551 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:10.295515 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:11.223871 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:11.223832 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:11.322763 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:11.322730 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:21.583736 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:21.583698 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:21.639438 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:21.639401 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:41.717477 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:41.717439 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:38:55.545458 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:55.545426 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-d6jj9_3fd1bdef-0c5a-47b4-b455-d30d3883462d/copy-manifests/0.log" Jun 12 18:38:55.557542 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:55.557519 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-d6jj9_3fd1bdef-0c5a-47b4-b455-d30d3883462d/manager/0.log" Jun 12 18:38:55.767317 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:55.767285 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5lqnh_0b914680-2e24-43dd-95ed-a969f011c15b/postgres/0.log" Jun 12 18:38:57.290740 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:57.290707 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zrztv_61b2c8e4-7f62-42bc-821c-8b02e61d5891/kuadrant-console-plugin/0.log" Jun 12 18:38:58.374603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:38:58.374574 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-wjd8f_b90f7d35-ae12-4acc-ae67-694c3d455646/kube-auth-proxy/0.log" Jun 12 18:39:03.886399 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.886362 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czmgj/must-gather-mr69m"] Jun 12 18:39:03.888817 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.888800 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:03.891503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.891477 2575 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-czmgj\"/\"default-dockercfg-w4ls6\"" Jun 12 18:39:03.891503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.891496 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czmgj\"/\"kube-root-ca.crt\"" Jun 12 18:39:03.891885 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.891867 2575 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-czmgj\"/\"openshift-service-ca.crt\"" Jun 12 18:39:03.899290 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.899269 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/must-gather-mr69m"] Jun 12 18:39:03.901361 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.901312 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:39:03.944051 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.944026 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcca8764-ce50-41b6-a3b8-f18157ee27a3-must-gather-output\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:03.944171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.944073 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlnpn\" (UniqueName: \"kubernetes.io/projected/dcca8764-ce50-41b6-a3b8-f18157ee27a3-kube-api-access-jlnpn\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:03.995348 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:03.995303 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:39:04.044984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.044956 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcca8764-ce50-41b6-a3b8-f18157ee27a3-must-gather-output\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:04.045112 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.045014 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlnpn\" (UniqueName: \"kubernetes.io/projected/dcca8764-ce50-41b6-a3b8-f18157ee27a3-kube-api-access-jlnpn\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:04.045292 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.045272 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/dcca8764-ce50-41b6-a3b8-f18157ee27a3-must-gather-output\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:04.053911 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.053884 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jlnpn\" (UniqueName: \"kubernetes.io/projected/dcca8764-ce50-41b6-a3b8-f18157ee27a3-kube-api-access-jlnpn\") pod \"must-gather-mr69m\" (UID: \"dcca8764-ce50-41b6-a3b8-f18157ee27a3\") " pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:04.198501 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.198474 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/must-gather-mr69m" Jun 12 18:39:04.325913 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.325884 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/must-gather-mr69m"] Jun 12 18:39:04.327902 ip-10-0-138-101 kubenswrapper[2575]: W0612 18:39:04.327875 2575 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poddcca8764_ce50_41b6_a3b8_f18157ee27a3.slice/crio-18480bfd299665778d22beb9902d7b93902427faac89e5d46a130253d9dca7c7 WatchSource:0}: Error finding container 18480bfd299665778d22beb9902d7b93902427faac89e5d46a130253d9dca7c7: Status 404 returned error can't find the container with id 18480bfd299665778d22beb9902d7b93902427faac89e5d46a130253d9dca7c7 Jun 12 18:39:04.329705 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:04.329686 2575 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jun 12 18:39:05.171504 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:05.171465 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/must-gather-mr69m" event={"ID":"dcca8764-ce50-41b6-a3b8-f18157ee27a3","Type":"ContainerStarted","Data":"18480bfd299665778d22beb9902d7b93902427faac89e5d46a130253d9dca7c7"} Jun 12 18:39:06.180915 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.180038 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/must-gather-mr69m" event={"ID":"dcca8764-ce50-41b6-a3b8-f18157ee27a3","Type":"ContainerStarted","Data":"284c91b1bea37568b35262f9a7ebb19c3ae9505461534e259ddd3359f4561595"} Jun 12 18:39:06.180915 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.180096 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/must-gather-mr69m" event={"ID":"dcca8764-ce50-41b6-a3b8-f18157ee27a3","Type":"ContainerStarted","Data":"66688ed5cc522ddc184f036f7c9993627fd4c64e66466b5af005242995903832"} Jun 12 18:39:06.196794 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.196734 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czmgj/must-gather-mr69m" podStartSLOduration=2.3415221600000002 podStartE2EDuration="3.196714006s" totalImagesPullingTime="855.191846ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-06-12 18:39:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:06.195967398 +0000 UTC m=+1037.052334321" watchObservedRunningTime="2026-06-12 18:39:06.196714006 +0000 UTC m=+1037.053080910" Jun 12 18:39:06.743493 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.743457 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-qx8fz_43267e23-e06f-44da-a07a-68d62c30f653/global-pull-secret-syncer/0.log" Jun 12 18:39:06.796990 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.796965 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" Jun 12 18:39:06.914269 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:06.914232 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-101.ec2.internal_382dde081b011bba9174dc4bb8126861/haproxy/0.log" Jun 12 18:39:11.024483 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:11.024446 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zrztv_61b2c8e4-7f62-42bc-821c-8b02e61d5891/kuadrant-console-plugin/0.log" Jun 12 18:39:13.293408 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.293060 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-546c9d8685-rlkwn_bf2b029b-5b1e-41b8-aa76-314ff271df57/metrics-server/0.log" Jun 12 18:39:13.414641 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.414477 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/node-exporter/0.log" Jun 12 18:39:13.437449 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.437414 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/kube-rbac-proxy/0.log" Jun 12 18:39:13.460705 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.460672 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgv4w_0204feba-07a8-4e35-ac92-e74cd39e74a3/init-textfile/0.log" Jun 12 18:39:13.586692 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.586660 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/kube-rbac-proxy-main/0.log" Jun 12 18:39:13.609230 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.609186 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/kube-rbac-proxy-self/0.log" Jun 12 18:39:13.633429 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.633376 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-6b8d965dd5-b2cnf_0293c94c-67dd-4694-b985-d8617e70eb5f/openshift-state-metrics/0.log" Jun 12 18:39:13.671045 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.671013 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/prometheus/0.log" Jun 12 18:39:13.689854 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.689829 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/config-reloader/0.log" Jun 12 18:39:13.709907 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.709880 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/thanos-sidecar/0.log" Jun 12 18:39:13.732534 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.732500 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/kube-rbac-proxy-web/0.log" Jun 12 18:39:13.752623 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.752597 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/kube-rbac-proxy/0.log" Jun 12 18:39:13.774215 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.774186 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/kube-rbac-proxy-thanos/0.log" Jun 12 18:39:13.794906 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.794858 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_ea4df7be-f6b1-4ae6-9b6a-67c72bb394ca/init-config-reloader/0.log" Jun 12 18:39:13.977887 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:13.977859 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/thanos-query/0.log" Jun 12 18:39:14.000309 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:14.000282 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-web/0.log" Jun 12 18:39:14.023850 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:14.023821 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy/0.log" Jun 12 18:39:14.040148 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:14.040122 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/prom-label-proxy/0.log" Jun 12 18:39:14.059459 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:14.059431 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-rules/0.log" Jun 12 18:39:14.078802 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:14.078768 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-575d84b964-9rhsq_3a0b9fe4-de89-4c8e-9732-9c665b6ffcfc/kube-rbac-proxy-metrics/0.log" Jun 12 18:39:18.001525 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.001489 2575 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w"] Jun 12 18:39:18.009712 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.009679 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.014782 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.014746 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w"] Jun 12 18:39:18.091989 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.091951 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-sys\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.092274 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.092246 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-lib-modules\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.092465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.092290 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-podres\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.092465 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.092441 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xnwfc\" (UniqueName: \"kubernetes.io/projected/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-kube-api-access-xnwfc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.092594 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.092473 2575 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-proc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.193891 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.193849 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-podres\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.194174 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194147 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-podres\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.194325 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194184 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xnwfc\" (UniqueName: \"kubernetes.io/projected/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-kube-api-access-xnwfc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.194507 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194486 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-proc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.194720 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194700 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-sys\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.194918 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194884 2575 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-lib-modules\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.195194 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.194548 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-proc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.195435 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.195407 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-sys\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.195593 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.195443 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-lib-modules\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.204266 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.204227 2575 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-xnwfc\" (UniqueName: \"kubernetes.io/projected/a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca-kube-api-access-xnwfc\") pod \"perf-node-gather-daemonset-g9d2w\" (UID: \"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca\") " pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.331653 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.331558 2575 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:18.520469 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:18.520384 2575 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w"] Jun 12 18:39:19.229570 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.229534 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfdjx_4692c660-7576-4e6d-b7c6-7c7b70200935/dns/0.log" Jun 12 18:39:19.250624 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.250593 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-cfdjx_4692c660-7576-4e6d-b7c6-7c7b70200935/kube-rbac-proxy/0.log" Jun 12 18:39:19.282056 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.282018 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" event={"ID":"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca","Type":"ContainerStarted","Data":"cfada63c4130b438f15f80af39dbd1bb69f44b9b2c401bc60d8c4c5820406e48"} Jun 12 18:39:19.282215 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.282083 2575 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" event={"ID":"a4d53c13-d3ea-4ff8-9105-056f2b8ad1ca","Type":"ContainerStarted","Data":"6a0006aeb17cf8a843bc37c69e6e7bdbeda81e3115f8f04119389fa64409d13f"} Jun 12 18:39:19.282215 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.282109 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:19.297588 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.297538 2575 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" podStartSLOduration=2.297522706 podStartE2EDuration="2.297522706s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-06-12 18:39:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-06-12 18:39:19.296988828 +0000 UTC m=+1050.153355728" watchObservedRunningTime="2026-06-12 18:39:19.297522706 +0000 UTC m=+1050.153889604" Jun 12 18:39:19.314788 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.314761 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-wwz6z_6391b6d3-45a0-4091-a618-49bb943fec3b/dns-node-resolver/0.log" Jun 12 18:39:19.867226 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:19.867187 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-npvkt_9d7ee0f1-0621-4eaa-80e1-64c6b36e43dc/node-ca/0.log" Jun 12 18:39:20.908861 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:20.908832 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-wjd8f_b90f7d35-ae12-4acc-ae67-694c3d455646/kube-auth-proxy/0.log" Jun 12 18:39:21.614423 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:21.614391 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-7gsd5_2e432100-d86d-471d-9e10-2539b77aba6f/serve-healthcheck-canary/0.log" Jun 12 18:39:22.329278 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:22.329244 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8jd4_174af75e-5737-4e3c-8ae8-c8518e0f9aed/kube-rbac-proxy/0.log" Jun 12 18:39:22.348503 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:22.348474 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8jd4_174af75e-5737-4e3c-8ae8-c8518e0f9aed/exporter/0.log" Jun 12 18:39:22.367983 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:22.367952 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-l8jd4_174af75e-5737-4e3c-8ae8-c8518e0f9aed/extractor/0.log" Jun 12 18:39:23.081310 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:23.081270 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:39:23.182937 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:23.182895 2575 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-phr44_0b9e5917-f6e4-4f0f-b815-f3012b76de10/konnectivity-agent/0.log" limit=1024 Jun 12 18:39:24.856245 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:24.856204 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-d6jj9_3fd1bdef-0c5a-47b4-b455-d30d3883462d/manager/0.log" Jun 12 18:39:24.874433 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:24.874404 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5877f56774-d6jj9_3fd1bdef-0c5a-47b4-b455-d30d3883462d/copy-manifests/0.log" Jun 12 18:39:24.950123 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:24.950094 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-5lqnh_0b914680-2e24-43dd-95ed-a969f011c15b/postgres/0.log" Jun 12 18:39:25.300659 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:25.300631 2575 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-czmgj/perf-node-gather-daemonset-g9d2w" Jun 12 18:39:26.468171 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:26.468132 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-dd95d798c-kqhml_50bc8715-ad3d-45f0-9e65-5644a15debba/manager/0.log" Jun 12 18:39:26.516965 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:26.516928 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-frm4j_89692129-7c22-4eb8-ba85-d4fb5664e459/openshift-lws-operator/0.log" Jun 12 18:39:31.832521 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:31.832491 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-tqrsw_ab7c4b0d-09af-44ea-ad9e-f258f76bc101/migrator/0.log" Jun 12 18:39:31.851355 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:31.851305 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d4bcd4867-tqrsw_ab7c4b0d-09af-44ea-ad9e-f258f76bc101/graceful-termination/0.log" Jun 12 18:39:32.257015 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:32.256981 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-52lnw_b8f30aa3-7444-4584-a06a-570e7153cd73/kube-storage-version-migrator-operator/1.log" Jun 12 18:39:32.257989 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:32.257965 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-7c578b78fc-52lnw_b8f30aa3-7444-4584-a06a-570e7153cd73/kube-storage-version-migrator-operator/0.log" Jun 12 18:39:32.448603 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:32.448566 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-wjd8f_b90f7d35-ae12-4acc-ae67-694c3d455646/kube-auth-proxy/0.log" Jun 12 18:39:33.524064 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.524034 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/kube-multus-additional-cni-plugins/0.log" Jun 12 18:39:33.543804 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.543775 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/egress-router-binary-copy/0.log" Jun 12 18:39:33.562573 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.562546 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/cni-plugins/0.log" Jun 12 18:39:33.581351 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.581318 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/bond-cni-plugin/0.log" Jun 12 18:39:33.600533 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.600511 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/routeoverride-cni/0.log" Jun 12 18:39:33.615359 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.615312 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-wjd8f_b90f7d35-ae12-4acc-ae67-694c3d455646/kube-auth-proxy/0.log" Jun 12 18:39:33.621984 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.621963 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/whereabouts-cni-bincopy/0.log" Jun 12 18:39:33.642477 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.642451 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-npmzx_6efd2e59-1317-4161-ad59-63118bc696f5/whereabouts-cni/0.log" Jun 12 18:39:33.887580 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:33.887501 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-n8pt9_a185510c-61d3-4ac2-ba4c-406dff6e9b16/kube-multus/0.log" Jun 12 18:39:34.071639 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:34.071579 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wnh5c_9aaf8a1f-48d4-4a84-b138-99724970fc5e/network-metrics-daemon/0.log" Jun 12 18:39:34.110498 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:34.110467 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-wnh5c_9aaf8a1f-48d4-4a84-b138-99724970fc5e/kube-rbac-proxy/0.log" Jun 12 18:39:35.304095 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:35.304048 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-controller/0.log" Jun 12 18:39:35.319117 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:35.319084 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6bf5d68d87-wjd8f_b90f7d35-ae12-4acc-ae67-694c3d455646/kube-auth-proxy/0.log" Jun 12 18:39:35.319513 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:35.319488 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/1.log" Jun 12 18:39:35.319703 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:35.319680 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/ovn-acl-logging/0.log" Jun 12 18:39:35.340726 ip-10-0-138-101 kubenswrapper[2575]: I0612 18:39:35.340701 2575 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-bt8dk_3bbd1cba-5ee5-496a-8cc9-678bfc147e2e/kube-rbac-proxy-node/0.log"